Cross-Attention Over RNA And Protein Sequences Enables Generalizable Interaction Prediction
Catalano, M.; Pepe, G.; Ausiello, G.; McWhite, C.; Gambosi, G.; Helmer-Citterich, M.; Gherardini, P. F.
Show abstract
Computational predictions are essential to characterize the RNA-protein interaction landscape, yet a persistent gap between benchmark performance and practical utility suggests that current models have limited generalization capabilities. To address this issue, we present CORAL (Cross-attention for RNA-protein Association Learning), a deep learning framework for the prediction of RNA-protein interactions that integrates pretrained protein (ESM-2) and RNA (DNABERT2) language models through bidirectional cross-attention with Low-Rank Adaptation fine-tuning. We also introduce a benchmarking framework that rigorously addresses the problem of data redundancy between training and test sets, which greatly inflates model performances reported in the literature. To this end we adopt three partitioning strategies of increasing stringency: conventional random splits, pairwise non-redundant splits, and component-wise non-redundant splits. CORAL maintains an F1 score of 0.65 under the most stringent component-wise evaluation, compared to 0.55 for the next-best method. Interpretability analyses reveal that specific cross-attention heads systematically attend to structurally defined contact positions between RNA and protein molecules, showing 27% elevated attention at interface residues across 309 experimentally resolved complexes (p < 0.01). These findings establish that current RPI prediction benchmarks substantially inflate performance estimates and demonstrate that cross-modal attention architectures yield improved generalization alongside mechanistically interpretable representations.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Benchmarking Pre-trained Genomic Language Models for RNA Sequence-Related Predictive Applications 97%
- Generative and predictive neural networks for the design of functional RNA molecules 96%
- Differential Analysis of RNA Structure Probing Experiments at Nucleotide Resolution: Uncovering Regulatory Functions of RNA Structure 96%
Similar papers in this journal
- Global Importance Analysis: An Interpretability Method to Quantify Importance of Genomic Features in Deep Neural Networks 97%
- EternaBrain: Automated RNA design through move sets from an Internet-scale RNA videogame 95%
- RNA structure prediction using positive and negative evolutionary information 95%
Similar papers in this journal
- Cat_Wiz: A stereochemistry-guided toolkit for locating, diagnosing and annotating Mg2+ ions in RNA structures. 96%
- DeepCLIP: Predicting the effect of mutations on protein-RNA binding with Deep Learning 96%
- IPANEMAP: Integrative Probing Analysis of Nucleic Acids Empowered by Multiple Accessibility Profiles 95%
Similar papers in this journal
- DeepLocRNA: An Interpretable Deep Learning Model for Predicting RNA Subcellular Localization with domain-specific transfer-learning 96%
- Estimating the power of sequence covariation for detecting conserved RNA structure 96%
- Thermodynamic modeling reveals widespread multivalent binding by RNA-binding proteins 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.