TriTower-m6Am: a triple-tower heterogeneous deep learning architecture integrating semantic, sequential, and structural information for mRNA N6,2'-O-dimethyladenosine site prediction
Xiong, K.; Jia, J.
Show abstract
BackgroundN6,2-O-dimethyladenosine (m6Am) is a cap-proximal mRNA modification deposited by PCIF1 at the first transcribed nucleotide of eukaryotic mRNAs. Knowing where m6Am sites sit across the transcriptome would help explain how cells tune mRNA stability and translation, but current computational predictors typically depend on a single sequence representation and do not jointly model the semantic, sequential, and structural signals carried by an RNA sequence. ResultsWe present TriTower-m6Am, a triple-tower architecture that combines three representations: semantic (RNA-FM with BellPooling), sequential (One-Hot BiLSTM), and structural (RGCN with three typed edges). On an independent test set of 640 sequences, TriTower-m6Am reaches AUC = 0.776, MCC = 0.440, and SN = 0.888, against DTC-m6Ams AUC = 0.765, MCC = 0.411, and SN = 0.800. The 8.8 percentage-point gain in sensitivity means that, for every 100 real m6Am sites, the model recovers roughly 9 additional sites missed by the previous best method. Among the three towers, RGCN alone gives the strongest single signal, and the AUC-weighted ensemble raises sensitivity from the 0.55-0.76 band of the standalone towers to 0.89. Ablating the RGCN edge types shows that backbone connectivity accounts for most of the structural signal. ConclusionsCombining semantic, sequential, and structural views of the same RNA sequence improves m6Am prediction beyond what any single representation achieves. Because each towers contribution to the final prediction is a readable voting weight rather than a hidden parameter, the model is not a black box: a user can read off which tower drove a given prediction and trace it back to the corresponding representation, without running a separate post-hoc explainer. The same design pattern can be transferred to other RNA modification site prediction tasks. Author summaryPredicting where m6Am modifications occur on messenger RNA is important for understanding how cells regulate transcript stability and translation. Existing computational methods typically encode the RNA sequence in a single way, such as k-mer counts or a one-hot code, and treat the model as a black box that emits a prediction without explaining which features drove it. We built TriTower-m6Am to address both limitations. Our model combines three independent encoders--a pretrained RNA language model for semantic patterns, a bidirectional LSTM for local nucleotide order, and a relational graph convolutional network for the structural fold--and fuses their outputs by AUC-weighted voting, so the contribution of each tower to a given prediction is a readable number rather than a hidden parameter. On an independent benchmark the ensemble improves sensitivity by 8.8 percentage points over the prior best method, and ablating the graphs edge types reveals that linear backbone connectivity, rather than long-range base-pairing, carries most of the structural signal. The same triple-tower pattern can be transferred to other RNA modification site prediction tasks.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Graph neural representational learning of RNA secondary structures for predicting RNA-protein interactions 95%
- DUETT quantitatively identifies known and novel events in nascent RNA structural dynamics from chemical probing data 95%
- DeepLocRNA: An Interpretable Deep Learning Model for Predicting RNA Subcellular Localization with domain-specific transfer-learning 95%
Similar papers in this journal
- EvoRMD: Integrating Biological Context and Evolutionary RNA Language Models for Interpretable Prediction of RNA Modifications 97%
- HydraRNA: a hybrid architecture based full-length RNA language model 96%
- Juggling offsets unlocks RNA-seq tools for fast scalable differential usage, aberrant splicing and expression analyses. 96%
Similar papers in this journal
- Rapid structure-function insights via hairpin-centric analysis of big RNA structure probing datasets 93%
- Informative RNA-base embedding for functional RNA structural alignment and clustering by deep representation learning 93%
- FASTCAR: Rapid alignment-free prediction of sequence alignment identity scores 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.