OmicsFM brings proteomics into the foundation model era
Heyndrickx, S.; Gabriels, R.; Ramadasan, H.; Martens, L.; Claeys, T.
Show abstract
While foundation models have been shown to learn biological representations from large transcriptomic atlases, it remained unknown whether proteomics data allow the same. We here therefore introduce OmicsFM, a modality-agnostic transformer pretrained through masked abundance reconstruction on an unprecedented proteomics data corpus of 48,837 quality-filtered proteomics profiles from 1,397 reprocessed PRIDE projects. Interestingly, despite training on 14- to 93-fold fewer profiles than matched bulk- and single-cell transcriptomic models, respectively, our proteomics model rivals both. On held-out projects, OmicsFM attention networks recovered more molecular relationships than co-expression methods and existing single-cell foundation models across nine reference databases that reveal pathway-level organization. Sample-level embeddings preserved biological structure across independent studies, and its representations transferred successfully to cell-type classification, gene-essentiality prediction, and perturbation-response prediction, while consistently outperforming task-specific models. Moreover, our results show that proteomics and transcriptomics representations capture complementary biology. OmicsFM thus firmly establishes the possibility of training highly performant proteomics-based foundation models, and their importance in modelling and uncovering fundamental biology.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- CAPTAIN: A multimodal foundation model pretrained on co-assayed single-cell RNA and protein 96%
- DGAT: A Dual-Graph Attention Network for Inferring Spatial Protein Landscapes from Transcriptomics 95%
- LEOPARD: missing view completion for multi-timepoints omics data via representation disentanglement and temporal knowledge transfer 95%
Similar papers in this journal
Similar papers in this journal
- Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states 95%
- Integrative, high-resolution analysis of single cell gene expression across experimental conditions with PARAFAC2-RISE 93%
- Widespread transcriptional memory shapes heritable states and functional heterogeneity in cancer and stem cells 92%
Similar papers in this journal
- Interpretable deep generative ensemble learning for single-cell omics with Hydra 94%
- PIFiA: Self-supervised Approach for Protein Functional Annotation from Single-Cell Imaging Data 94%
- Turnover and replication analysis by isotope labeling (TRAIL) reveals the influence of tissue context on protein and organelle lifetimes 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.