OPUS-GO: An interpretable protein/RNA sequence annotation framework based on biological language model
Xu, G.; Lv, Y.; Zhang, R.; Xia, X.; Wang, Q.; Ma, J.
Show abstract
Accurate annotation of protein and RNA sequences is essential for understanding their structural and functional attributes. However, due to the relative ease of obtaining whole sequence-level annotations compared to residue-level annotations, existing biological language model (BLM)-based methods often prioritize enhancing sequence-level classification accuracy while neglecting residue-level interpretability. To address this, we introduce OPUS-GO, which exclusively utilizes sequence-level annotations to provide both sequence-level and residue-level classification results. In other words, OPUS-GO not only provides the sequence-level annotations but also offers the rationale behind these predictions by pinpointing their corresponding most critical residues within the sequence. Our results show that, by leveraging features derived from BLMs and our modified Multiple Instance Learning (MIL) strategy, OPUS-GO exhibits superior sequence-level classification accuracy compared to baseline methods in most downstream tasks. Furthermore, OPUS-GO demonstrates robust interpretability by accurately identifying the residues associated with the corresponding labels. Additionally, the OPUS-GO framework can be seamlessly integrated into any language model, enhancing both accuracy and interpretability for their downstream tasks.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- FAPM: Functional Annotation of Proteins using Multi-Modal Models Beyond Structural Modeling 96%
- VoroCNN: Deep convolutional neural network built on 3D Voronoi tessellation of protein structures 96%
- Pair-EGRET: enhancing the prediction of protein-proteininteraction sites through graph attention networks and protein language models 95%
Similar papers in this journal
- Improving protein function prediction by learning and integrating representations of protein sequences and function labels 95%
- SAINT-Angle: self-attention augmented inception-inside-inception network and transfer learning improve protein backbone torsion angle prediction 95%
- Estimating Protein Complex Model Accuracy Using Graph Transformers and Pairwise Similarity Graphs 94%
Similar papers in this journal
- Species-specific design of artificial promoters by transfer-learning based generative deep-learning model 95%
- Best practices for perturbation MPRA--a computational evaluation framework of sequence design strategies 94%
- RaptRanker: in silico RNA aptamer selection from HT-SELEX experiment based on local sequence and structure information 94%
Similar papers in this journal
- Informative RNA-base embedding for functional RNA structural alignment and clustering by deep representation learning 96%
- Mutation effect estimation on protein-protein interactions using deep contextualized representation learning 95%
- cgRNASP: coarse-grained statistical potentials with residue separation for RNA structure evaluation 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.