ESM-LoRA-Gly: Improved prediction of N- and O-linked glycosylation sites by tuning protein language models with low-rank adaptation (LoRA)
Feng, Z.; Zhang, X.; Wang, H.; Hong, X.; Zhan, J.; Zhou, Y.
Show abstract
Glycosylation associates with many diseases ranging from cancer to neurodegeneration and understanding these disease mechanisms requires the precise identification of glycosylation sites. Computational prediction of glycosylation sites has been useful to complement laborious experimental methods, while existing tools lack sufficient accuracy and scalability. Here, we introduce ESM-LoRA-Gly, a method that employs Low-Rank Adaptation (LoRA) to fine-tune the ESM2-3B protein language model for predicting both N- and O-linked glycosylation sites. According to the evaluation on the benchmark datasets, ESM-LoRA-Gly outperforms existing state-of-the-art techniques. The improvement is particularly significant (>100% in Matthews correlation coefficient) for the O-linked dataset. By substantially reducing trainable parameters while maintaining predictive power, ESM-LoRA-Gly enables computationally efficient proteome-scale predictions. This approach should be instrumental for advancing glycoproteomic research and accelerating therapeutic discovery for glycosylation-related diseases.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Pair-EGRET: enhancing the prediction of protein-proteininteraction sites through graph attention networks and protein language models 95%
- FAPM: Functional Annotation of Proteins using Multi-Modal Models Beyond Structural Modeling 94%
- Learning Context-aware Structural Representations to Predict Antigen and Antibody Binding Interfaces 94%
Similar papers in this journal
- SAINT-Angle: self-attention augmented inception-inside-inception network and transfer learning improve protein backbone torsion angle prediction 95%
- Improving protein function prediction by learning and integrating representations of protein sequences and function labels 94%
- nanoBERT: A deep learning model for gene agnostic navigation of the nanobody mutational space 93%
Similar papers in this journal
- Comprehensive analysis of lectin-glycan interactions reveals determinants of lectin specificity 94%
- THLANet: A Deep Learning Framework for Predicting TCR-pHLA Binding in Immunotherapy Applications 94%
- Paying Attention to Attention: High Attention Sites as Indicators of Protein Family and Function in Language Models 94%
Similar papers in this journal
- DeepNeuropePred: a robust and universal tool to predict cleavage sites from neuropeptide precursors by protein language model 94%
- Physical-aware model accuracy estimation for protein complex using deep learning method 93%
- Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-Human interactions 92%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.