Lemur: A Single-Cell Foundation Model with Fine-Tuning-Free Hierarchical Cell-Type Generation for Drosophila melanogaster
Botas, J.; Jia, J.; Pasupuleti, S.; Chen, H.; Hu, X.; Xu, Z.; Liu, Z.
Show abstract
Single-cell genomics has revolutionized our understanding of cellular heterogeneity, but automating its analysis remains an open challenge. Cell-type annotation represents a critical bottleneck, particularly as datasets grow in size and complexity. While foundation models have shown promise in addressing this challenge, existing approaches require extensive fine-tuning for effective cell-type annotation. Here, we present Lemur (Large Expression Model for Understanding scRNA-seq), a single-cell foundation model specifically designed for Drosophila melanogaster. Lemur achieves fine-tuning-free cell-type annotation through comprehensive pre-training on an integrated whole-organism atlas with a unified cell-type annotation schema. To leverage this unified schema, we developed a dedicated hierarchical cell-type decoder architecture. This approach enables Lemur to generate consistent cell-type predictions across multiple levels of granularity without requiring additional training on new datasets. The model demonstrates strong performance across diverse tissue types, experimental conditions, and sequencing technologies. It also achieves batch-effect correction without explicitly training for this task. This automated analysis capability positions Lemur as an effective tool for the fly research community. Beyond its immediate applications, Lemur establishes a framework for accelerating biological discovery. It enables rapid iteration between computational predictions and experimental validation in the highly controlled Drosophila melanogaster system, with potential implications for translational research in human biology, particularly in aging and neurodegenerative disease studies.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Learning interpretable cellular and gene signature embeddings from single-cell transcriptomic data 97%
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 97%
- uniPort: a unified computational framework for single-cell data integration with optimal transport 97%
Similar papers in this journal
- Simultaneous dimensionality reduction and integration for single-cell ATAC-seq data using deep learning 97%
- Inferring spatial single-cell-level interactions through interpreting cell state and niche correlations learned by self-supervised graph transformer 96%
- Learning the rules of cell competition without prior scientific knowledge 95%
Similar papers in this journal
- Cross-species imputation and comparison of single-cell transcriptomic profiles 97%
- CMOT: Cross Modality Optimal Transport for multimodal inference 96%
- scCross: A Deep Generative Model for Unifying Single-cell Multi-omics with Seamless Integration, Cross-modal Generation, and In-silico Exploration 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.