Unlocking biological insight from single-cell data with an interpretable dual-stream foundation model
Guo, H.; Cui, Q.; Zhang, X.; Chen, C.; Zheng, W.; Cai, C.; Wang, X.; Wang, S.
Show abstract
Deep learning foundation models are revolutionizing single-cell biology, yet learning holistic and discriminative representations from complex, high-dimensional data remains a central challenge. Although Transformer-based single-cell language models have shown significant progress, they typically rely on a single input-encoding scheme, a practice that results in the loss of critical gene expression information and hinders the effective learning of global cellular representations. To address these challenges, we introduce scDMC, an innovative single-cell Dual-stream Masked Contrastive pre-training framework designed to synergistically optimize information fidelity at both the gene and cellular levels. Pre-trained on only 2 million cells far fewer than the datasets used by mainstream models, scDMC sets a new state-of-the-art in multiple benchmark tasks, including cell annotation, clustering, and data integration. More importantly, we demonstrate that scDMC can uncover functional gene modules, infer cell-type-specific regulatory networks in a data-driven manner, and exhibits a high degree of biological interpretability.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 98%
- scDREAMER: atlas-level integration of single-cell datasets using deep generative model paired with adversarial classifier 98%
- Learning interpretable cellular and gene signature embeddings from single-cell transcriptomic data 97%
Similar papers in this journal
- Inferring spatial single-cell-level interactions through interpreting cell state and niche correlations learned by self-supervised graph transformer 96%
- Simultaneous dimensionality reduction and integration for single-cell ATAC-seq data using deep learning 96%
- Delineating the Effective Use of Self-Supervised Learning in Single-Cell Genomics 96%
Similar papers in this journal
- Ultrafast and interpretable single-cell 3D genome analysis with Fast-Higashi 96%
- scTrace+: enhance the cell fate inference by integrating the lineage-tracing and multi-faceted transcriptomic similarity information 96%
- scCausalVI disentangles single-cell perturbation responses with causality-aware generative model 96%
Similar papers in this journal
- CMOT: Cross Modality Optimal Transport for multimodal inference 97%
- A Message Passing Framework for Precise Cell State Identification with scClassify2 97%
- scCross: A Deep Generative Model for Unifying Single-cell Multi-omics with Seamless Integration, Cross-modal Generation, and In-silico Exploration 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.