Integrating Millions of Years of Evolutionary Information into Protein Structure Models for Function Prediction
Ma, R.; He, C.; Zhang, Z.; Zheng, H.; Duan, L.
Show abstract
BackgroundUnderstanding life processes relies on accurate protein function prediction, fundamentally requiring the integration of evolutionary information encoded in sequences with spatial characteristics from 3D structures. Existing approaches often face limitations, however, by either over-relying on sequence, using simplified structural representations instead of fine-grained spatial details, or failing to capture the synergistic relationship between sequence and structure, compounded by challenges in acquiring annotated data. ResultsTo address these issues, we propose a novel contrast-aware pre-training framework, ESMSCOP. ESMSCOP leverages a state-of-the-art protein language model to harness evolutionary insights embedded in sequences, and introduces a new encoder to fuse topological and fine-grained spatial structural features. By employing a contrastive pre-training strategy with auxiliary supervision, ESMSCOP effectively bridges the sequence-structure gap, yielding rich and informative representations. ConclusionsExtensive experiments conducted on multiple benchmark datasets demonstrate that ESMSCOP achieves superior performance in protein function prediction tasks compared to existing methods. Furthermore, it shows strong performance even when utilizing relatively less pre-training data compared to some large-scale models.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Pair-EGRET: enhancing the prediction of protein-proteininteraction sites through graph attention networks and protein language models 98%
- FAPM: Functional Annotation of Proteins using Multi-Modal Models Beyond Structural Modeling 98%
- ProteinBERT: A universal deep-learning model of protein sequence and function 97%
Similar papers in this journal
Similar papers in this journal
- MULAN: Multimodal Protein Language Model for Sequence and Structure Encoding 98%
- SAINT-Angle: self-attention augmented inception-inside-inception network and transfer learning improve protein backbone torsion angle prediction 97%
- Improving protein function prediction by learning and integrating representations of protein sequences and function labels 96%
Similar papers in this journal
- Combined topological data analysis and geometric deep learning reveal niches by the quantification of protein binding pockets 97%
- ProALIGN: Directly learning alignments for protein structure prediction via exploiting context-specific alignment motifs 96%
- Critiquing Protein Family Classification Models Using Sufficient Input Subsets 95%
Similar papers in this journal
- Paying Attention to Attention: High Attention Sites as Indicators of Protein Family and Function in Language Models 96%
- Designing diverse and high-performance proteins with a large language model in the loop 95%
- Computational design of novel Cas9 PAM-interacting domains using evolution-based modelling and structural quality assessment 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.