RegimeFormer: A Large Protein Model of Global Perturbation Regimes
Ma, S.; Chai, Y.; Wu, Y.; Zhang, Q.; Yuan, Y.; Zhao, K.; Chen, Z.; Wang, H.; Cao, S.; Yu, X.; Han, X.; Liu, Y.; Liu, Y.; Zhu, T.; Tao, D.
Show abstract
Protein language models organize sequence and structure at scale, but a global representation of how proteins respond to mutation remains lacking. We present RegimeFormer, a large protein perturbation model coupled to RegimeAtlas, constructed by harmonizing and indexing 202,556,313 non-redundant protein sequences across the tree of life. A diversity-preserving one-million-protein subset provides the high-resolution training and inference layer, with 995,995 proteins yielding residue-level summaries across 407,048,356 residues and substitution-specific predictions available on demand. Across experimental deep mutational scanning, molecular benchmarks, structural confidence and evolutionary constraint, RegimeFormer identifies reproducible protein-level perturbation regimes that organize residue fragility, adaptability and predictive uncertainty. Regime conditioning improves substitution-specific prediction, with the largest relative gains under unseen-protein, unseen-family and low-homology evaluation. RegimeFormer-derived molecular priors further improve downstream transcriptomic and drug-response modelling. Together, RegimeFormer and RegimeAtlas provide a scalable framework for mapping, predicting and querying protein perturbation landscapes across global sequence space.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory Hierarchies 95%
- CAPTAIN: A multimodal foundation model pretrained on co-assayed single-cell RNA and protein 95%
- PreMode predicts mode-of-action of missense variants by deep graph representation learning of protein sequence and structural context 95%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.