Self-supervised learning on millions of pre-mRNA sequences improves sequence-based RNA splicing prediction
Chen, K.; Zhou, Y.; Ding, M.; Wang, Y.; Ren, Z.; Yang, Y.
Show abstract
RNA splicing is an important post-transcriptional process of gene expression in eukaryotic cells. Predicting RNA splicing from primary sequences can facilitate the interpretation of genomic variants. In this study, we developed a novel self-supervised pre-trained language model, SpliceBERT, to improve sequence-based RNA splicing prediction. Pre-training on pre-mRNA sequences from vertebrates enables SpliceBERT to capture evolutionary conservation information and characterize the unique property of splice sites. SpliceBERT also improves zero-shot prediction of variant effects on splicing by considering sequence context information, and achieves superior performance for predicting branchpoint in the human genome and splice sites across species. Our study highlighted the importance of pre-training genomic language models on a diverse range of species and suggested that pre-trained language models were promising for deciphering the sequence logic of RNA splicing.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Splam: a deep-learning-based splice site predictor that improves spliced alignments 97%
- Improved modeling of RNA-binding protein motifs in an interpretable neural model of RNA splicing 95%
- DeepSAP: Improved RNA-Seq Alignment by Integrating Transcriptome Guidance with Transformer-Based Splice Junction Scoring 95%
Similar papers in this journal
- Shiba: A versatile computational method for systematic identification of differential RNA splicing across platforms 96%
- Analysis of RNA translation with a deep learning architecture provides new insight into translation control 95%
- DeepCLIP: Predicting the effect of mutations on protein-RNA binding with Deep Learning 94%
Similar papers in this journal
- Informative RNA-base embedding for functional RNA structural alignment and clustering by deep representation learning 95%
- Rapid structure-function insights via hairpin-centric analysis of big RNA structure probing datasets 94%
- Binding patterns of RNA binding proteins to repeat-derived RNA sequences reveal putative functional RNA elements 93%
Similar papers in this journal
- DeepLocRNA: An Interpretable Deep Learning Model for Predicting RNA Subcellular Localization with domain-specific transfer-learning 95%
- JEDI: Circular RNA Prediction based on Junction Encoders and Deep Interaction among Splice Sites 95%
- Thermodynamic modeling reveals widespread multivalent binding by RNA-binding proteins 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.