Exploring Protein-DNA Binding Residue Prediction and Consistent Interpretability Analysis Using Deep Learning
Liu, Y.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWAccurately identifying DNA-binding residues is a crucial step in developing computational tools to model DNA-protein binding properties, which is essential for binding pocket discovery and related drug design. Although several tools have been developed to predict DNA-binding residues based on protein sequences and structures, their performance remains limited, and proteins with crystal structures still represent only a small fraction of DNA-binding proteins. Additionally, the process of extracting handcrafted features for protein representation is labor-intensive. In this study, we combined the strengths of pre-trained protein language models and attention mechanisms to propose a sequence-based method: an attention-based deep learning approach for accurately predicting DNA-binding residues, incorporating a contrastive learning module. Our method outperformed all other sequence-based models across two prevalent benchmark datasets. Furthermore, we developed a structure-based graph neural network (GNN) model to demonstrate the impact of the contrastive module. A common limitation of existing models is their lack of interpretability, which hinders our ability to understand what these models have learned. To address this, we introduced a novel perspective for interpreting our sequence-based model by analyzing the consistency between attention scores and the edge weights generated by the GNN model. Interestingly, our results show that large-scale pre-trained protein language models, together with attention mechanisms, can effectively capture structural information solely from protein sequence inputs.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Pair-EGRET: enhancing the prediction of protein-proteininteraction sites through graph attention networks and protein language models 98%
- FAPM: Functional Annotation of Proteins using Multi-Modal Models Beyond Structural Modeling 97%
- Learning Context-aware Structural Representations to Predict Antigen and Antibody Binding Interfaces 96%
Similar papers in this journal
Similar papers in this journal
- SAINT-Angle: self-attention augmented inception-inside-inception network and transfer learning improve protein backbone torsion angle prediction 97%
- Improving protein function prediction by learning and integrating representations of protein sequences and function labels 96%
- MULAN: Multimodal Protein Language Model for Sequence and Structure Encoding 96%
Similar papers in this journal
- Paying Attention to Attention: High Attention Sites as Indicators of Protein Family and Function in Language Models 95%
- Computational design of novel Cas9 PAM-interacting domains using evolution-based modelling and structural quality assessment 95%
- Predicting Affinity Through Homology (PATH): Interpretable Binding Affinity Prediction with Persistent Homology 94%
Similar papers in this journal
- From Proteins to Ligands: Decoding Deep Learning Methods for Binding Affinity Prediction 97%
- From Signal to Symphony: Exploring 2D Sequence Representations for Protein Function Prediction 96%
- ProAffinity-GNN: A Novel Approach to Structure-based Protein-Protein Binding Affinity Prediction via a Curated Dataset and Graph Neural Networks 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.