Ontology-based Protein-Protein Interaction Explanation Using Large Language Models
Cam, N. B.; Rehana, H.; Zheng, J.; Bansal, B.; He, Y.; Hur, J.; Ozgur, A.
Show abstract
Protein-protein interactions (PPIs) play a crucial role in various biological processes, and understanding these interactions is essential for advancing biomedical research. Automated extraction and analysis of PPI information from the rapidly growing scientific literature remains an important challenge. We present a novel ontology-based approach to analyze protein-protein interactions using Large Language Models (LLMs). We applied different learning strategies, namely in-context learning and parameter-efficient instruction fine-tuning for the Llama-2 chat models, to identify keywords in the text that indicate an interaction between a pair of proteins. Our results show that parameter-efficient fine-tuning leads to a performance gain even when the domain is new. The smaller fine-tuned models outperformed the zero-shot performance of much larger models. The keywords identified by the Llama-2 models were mapped to the ontology terms in the Interaction Network Ontology (INO). Our study suggests that a pipeline of an LLM and an ontology is an effective strategy for explaining relations between biomedical entities. This work demonstrates the potential of leveraging ontologies and advanced language models to advance automated PPI analysis from the scientific literature.
Matching journals
The top 11 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- DeepGene: An Efficient Foundation Model for Genomics based on Pan-genome Graph Transformer 95%
- Learning universal knowledge graph embedding for predicting biomedical pairwise interactions 93%
- iDRKAN: Interpretable miRNA-Disease Association Prediction Based on Dual-Graph Representation Learning and Kolmogorov-Arnold Network 93%
Similar papers in this journal
Similar papers in this journal
- Bridging Auditory Perception and Natural Language Processing with Semantically informed Deep Neural Networks 95%
- A novel interpretable deep transfer learning combining diverse learnable parameters for improved T2D prediction based on single-cell gene regulatory networks 93%
- Unsupervised generative and graph representation learning for modelling cell differentiation 92%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.