Integrated pretraining with evolutionary information to improve RNA secondary structure prediction
Yan, Z.; Hamilton, W. L.; Blanchette, M. D.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWRNA secondary structure prediction is a fundamental task in computational and molecular biology. While machine learning approaches in this area have been shown to improve upon traditional RNA folding algorithms, performance remains limited for several reasons such as the small number of experimentally determined RNA structures and suboptimal use of evolutionary information. To address these challenges, we introduce a practical and effective pretraining strategy that enables learning from a larger set of RNA sequences with computationally predicted structures and in the meantime, tapping into the rich evolutionary information available in databases such as Rfam. Coupled with a flexible and scalable neural architecture that can navigate different learning scenarios while providing ease of integrating evolutionary information, our approach significantly improves upon state-of-the-art across a range of benchmarks, including both single sequence and alignment based structure prediction tasks, with particularly notable benefits on new, less well-studied RNA families. Our source code, data and packaged RNA secondary structure prediction software RSSMFold can be accessed at https://github.com/HarveyYan/RSSMFold.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- UFold: Fast and Accurate RNA Secondary Structure Prediction with Deep Learning 98%
- IPANEMAP: Integrative Probing Analysis of Nucleic Acids Empowered by Multiple Accessibility Profiles 95%
- LazySampling and LinearSampling: Fast Stochastic Sampling of RNA Secondary Structure with Applications to SARS-CoV-2 95%
Similar papers in this journal
Similar papers in this journal
- Graph neural representational learning of RNA secondary structures for predicting RNA-protein interactions 98%
- ConsAlign: simultaneous RNA structural aligner based on rich transfer learning and thermodynamic ensemble model of alignment scoring 97%
- Deep learning models for RNA secondary structure prediction (probably) do not generalise across families 95%
Similar papers in this journal
- Deep Learning for RNA Secondary Structure Determination: Gauging Generalizability and Broadening the Scope of Traditional Methods 98%
- De novo prediction of RNA-protein interactions with Graph Neural Networks 96%
- Unspecific binding but specific disruption of the group I intron by the StpA chaperone 94%
Similar papers in this journal
- Interpreting Neural Networks for Biological Sequences by Learning Stochastic Masks 96%
- Predicting RNA 3D structure and conformers using a pre-trained secondary structure model and structure-aware attention 95%
- A 5' UTR Language Model for Decoding Untranslated Regions of mRNA and Function Predictions 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.