Fine-Tuning Protein Language Models on Human Spatial Constraint Yields State-of-the-Art Variant Effect Prediction
Bajracharya, G.; Capra, J. A.
Show abstract
Protein language models (PLMs) achieve state-of-the-art performance in predicting effects of missense variants, yet they do not explicitly consider variation within the human population. Here, we introduce Human Spatial Constraint (HuSC), a framework for quantifying intraspecies constraint on missense variants that integrates population-scale human genetic variation with 3D protein structures. We then fine-tune PLMs on HuSC scores. HuSC models the expected frequency of missense variation under neutral evolution and compares it to observed variation, accounting for both variation in mutational processes and 3D structural context. HuSC outperforms traditional inter- and intraspecies conservation metrics in predicting pathogenic variants. By focusing on intraspecies variation, HuSC reveals protein sites under human-specific constraint that cannot be captured by interspecies models. Integrating this intraspecies perspective into PLMs by fine-tuning on HuSC scores improves the prediction of variant fitness from deep mutational scans across diverse taxa and functional assay types. The improvement after fine-tuning comes largely from reducing bias toward wild-type sequences in regions that tolerate variation. Together, these results demonstrate that combining intraspecies constraint with cross-species PLMs improves their performance in variant-effect interpretation.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Understanding epistatic networks in the B1 -lactamases through coevolutionary statistical modeling and deep mutational scanning 97%
- PreMode predicts mode-of-action of missense variants by deep graph representation learning of protein sequence and structural context 97%
- DeMAG predicts the effects of variants in clinically actionable genes by integrating structural and evolutionary epistatic features 97%
Similar papers in this journal
- A mutation rate model at the basepair resolution identifies the mutagenic effect of Polymerase III transcription 96%
- Sequence-based modeling of genome 3D architecture from kilobase to chromosome-scale 95%
- Accurate rare variant phasing of whole-genome and whole-exome sequencing data in the UK Biobank 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.