Back

ChemBERTaDDI: Transforming Drug-Drug Interaction Prediction with Transformers and Clinical Insights

Gromova, A. A.; Maida, A. S.

2025-01-25 bioinformatics
10.1101/2025.01.22.634309 bioRxiv
Show abstract

The problem of polypharmacy arises when two or more drugs taken in combination cause adverse side effects, even when the use of the drugs individually causes no harm. Drug-drug interactions (DDIs) are a major cause of these reactions, contributing to increased morbidity and mortality. As the potential for harmful DDI grows combinatorially, the prediction of drug-drug interactions is increasingly critical for patient safety and effective healthcare management. In this paper, we present the ChemBERTaDDI frame-work a robust approach that uses transformer self-attention to extract latent molecular representations. By employing ChemBERTa-77M-MLM--a transformer-based language model pretrained on SMILES sequences--our approach generates enriched chemical embeddings that capture detailed molecular structural information. These embeddings are integrated with clinical mono side effect data and processed through a DNN predictor, enabling the learning of complex pairwise interaction patterns with minimal architectural overhead. Experiments performed using this combined data on a benchmark data set show superior performance compared with five state-of-the-art methods: Decagon, DeepDDI, MDF-SA-DDI, DPSP and NNPS. ChemBER-TaDDI outperforms the baseline architectures, as measured by F1 and AUROC, and generalizes to new introduced drug compounds.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.