DrugLM: A Unified Framework to Enhance Drug-Target Interaction Predictions by Incorporating Textual Embeddings via Language Models
Li, T.; Fang, Z.; Zhang, X.; Tang, K.; Chen, H.; Jiang, Z.; Zhao, T.; Xu, R.; Cheng, F.; Li, X.; Li, J.
Show abstract
MotivationAccurate prediction of drug-target interactions (DTIs) is central to computational drug discovery, offering the potential to reduce experimental costs and accelerate development timelines. While existing deep learning approaches such as Graph Neural Networks and Transformers have shown promise, they often overlook the rich semantic information embedded in textual descriptions of drugs and targets. These descriptions encode critical biomedical knowledge, including mechanisms of action, biological pathways involved, and therapeutic effects of drugs, which can enhance DTI prediction performance. ResultsWe introduce DrugLM, a unified framework that integrates embeddings derived from large language models (LLMs) into DTI-specific model architectures. DrugLM leverages textual descriptions of drugs and targets to generate semantic embeddings using a range of pretrained LLMs. These embeddings can be seamlessly incorporated into existing DTI models. We systematically evaluate multiple LLMs on benchmark DTI datasets and demonstrate strong performance even without fine-tuning. Moreover, supervised parameter-efficient fine-tuning of the LLMs further improves embedding quality, leading to enhanced prediction accuracy. Notably, a simple multilayer perceptron (MLP) using only LLM-derived embeddings surpasses several established DTI methods, underscoring the power of semantic features. Our findings highlight the practical value of integrating LLMs into DTI pipelines and offer a straightforward recipe for improved drug discovery: LLM embeddings of drugs and targets are both effective and easy to use. AvailabilityOur code and dataset are available at https://github.com/ShPhoebus/DrugLM
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- DTI-Voodoo: machine learning over interaction networks and ontology-based background knowledge predicts drug-target interactions 97%
- One-Hot News: Drug Synergy Models Shortcut Molecular Features 96%
- AITL: Adversarial Inductive Transfer Learning with input and output space adaptation for pharmacogenomics 95%
Similar papers in this journal
Similar papers in this journal
- Generating hard-to-obtain information from easy-to-obtain information: applications in drug discovery and clinical inference 95%
- Inferring global-scale temporal latent topics from news reports to predict public health interventions for COVID-19 94%
- Tokenized and Continuous Embedding Compressions of Protein Sequence and Structure 94%
Similar papers in this journal
- CASTER-DTA: Equivariant Graph Neural Networks for Predicting Drug-Target Affinity 96%
- GexMolGen: Cross-modal Generation of Hit-like Molecules via Large Language Model Encoding of Gene Expression Signatures 95%
- Scalable embedding fusion with protein language models: insights from benchmarking text-integrated representations 95%
Similar papers in this journal
- TrustAffinity: accurate, reliable and scalable out-of-distribution protein-ligand binding affinity prediction using trustworthy deep learning 94%
- An interpretable deep learning framework for genome-informed precision oncology 93%
- Accelerating protein engineering with fitness landscape modeling and reinforcement learning 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.