Language models enable zero-shot prediction of the effects of mutations on protein function
Meier, J.; Rao, R.; Verkuil, R.; Liu, J.; Sercu, T.; Rives, A.
Show abstract
Modeling the effect of sequence variation on function is a fundamental problem for understanding and designing proteins. Since evolution encodes information about function into patterns in protein sequences, unsupervised models of variant effects can be learned from sequence data. The approach to date has been to fit a model to a family of related sequences. The conventional setting is limited, since a new model must be trained for each prediction task. We show that using only zero-shot inference, without any supervision from experimental data or additional training, protein language models capture the functional effects of sequence variation, performing at state-of-the-art.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Designing diverse and high-performance proteins with a large language model in the loop 97%
- Paying Attention to Attention: High Attention Sites as Indicators of Protein Family and Function in Language Models 97%
- Computational design of novel Cas9 PAM-interacting domains using evolution-based modelling and structural quality assessment 97%
Similar papers in this journal
- Beyond the Leaderboard: Leveraging Predictive Modeling for Protein-Ligand Insights and Discovery 96%
- Pair-EGRET: enhancing the prediction of protein-proteininteraction sites through graph attention networks and protein language models 96%
- ProteinBERT: A universal deep-learning model of protein sequence and function 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.