Multi-modal single-cell foundation models via dynamic token adaptation
Zhao, W.; Solaguren-Beascoa, A.; Neilson, G.; Muhammed, L.; Laaniste, L.; Cakiroglu, S. A.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWRecent advances in applying deep learning in genomics include DNA-language and single-cell foundation models. However, these models take only one data type as input. We introduce dynamic token adaptation and demonstrate how it combines these models to predict gene regulation at the single-cell level in different genetic contexts. Although the method is generalisable, we focus on an illustrative example by training an adapter from DNA-sequence embeddings to a single-cell foundation models token embedding space. As a qualitative evaluation, we assess the impact of DNA sequence changes on the models learned gene regulatory networks by mutating the transcriptional start site of the transcription factor GATA4 in silico, observing predicted expression changes in its target genes in fetal cardiomyocytes.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- A scalable computational framework for predicting gene expression from candidate cis-regulatory elements 95%
- Automated quality control and cell identification of droplet-based single-cell data using dropkick 95%
- netNMF-sc: Leveraging gene-gene interactions for imputation and dimensionality reduction in single-cell expression analysis 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.