RNAGenesis: Foundation Model for Enhanced RNA Sequence Generation and Structural Insights
Zhang, Z.; Chao, L.; Jin, R.; Zhang, Y.; Zhou, G.; Yang, Y.; Yang, Y.; Huang, K.; Yang, Q.; Xu, Z.; Zhang, X.; Cong, L.; Wang, M.
Show abstract
RNA molecules are central to gene regulation, catalysis, and molecular recognition, and offer broad opportunities for therapeutic applications. However, uncovering their complex sequence, structure, and function relationships, particularly for non-coding RNAs, remains a formidable challenge. Here, we introduce RNAGenesis, a Generalist RNA foundation model that integrates sequence representation, structural prediction, and de novo functional design within a single generative framework. Trained on diverse clustered non-coding RNAs, RNAGenesis leverages a BERT-style encoder, query-based latent compression, and a diffusion-guided decoder enhanced by inference-time alignment with gradient guidance and beam search strategies. Through comprehensive evaluations, RNAGenesis achieves state-of-the-art performance on 11 of 13 tasks in the BEACON benchmark and surpasses structure-aware models in inverse folding, 3D structure prediction, and de novo structure design. We further introduce RNATx-Bench, a dedicated benchmark for RNA therapeutics comprising over 100,000 experimentally validated sequences. RNAGenesis demonstrates strong predictive performance across ASOs, siRNAs, shRNAs, circRNAs, and untranslated region (UTR) variants. Furthermore, RNAGenesis enables functional RNA design, including aptamers targeting IGFBP3 and structurally constrained sgRNA scaffolds. Wet-lab validation confirms aptamer binding with KD values as low as 4.02 nM and up to 2.5-fold improvement in editing efficiency across CRISPR-Cas9, base editing, and prime editing systems. These results position RNAGenesis as a next-generation general-purpose RNA foundation model with broad utility for computational modeling and experimental therapeutic design.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- DeepCLIP: Predicting the effect of mutations on protein-RNA binding with Deep Learning 95%
- ModiDeC: a multi-RNA modification classifier for direct nanopore sequencing 95%
- Integrating convolution and self-attention improves language model of human genome for interpreting non-coding regions at base-resolution 94%
Similar papers in this journal
- A systematic evaluation of data processing and problem formulation of CRISPR off-target site prediction 94%
- Learning interpretable cellular embedding for inferring biological mechanisms underlying single-cell transcriptomics 94%
- Deep autoregressive generative models capture the intrinsics embedded in T-cell receptor repertoires 94%
Similar papers in this journal
- A 5' UTR Language Model for Decoding Untranslated Regions of mRNA and Function Predictions 97%
- Predicting RNA 3D structure and conformers using a pre-trained secondary structure model and structure-aware attention 95%
- Delineating the Effective Use of Self-Supervised Learning in Single-Cell Genomics 94%
Similar papers in this journal
- DeepLocRNA: An Interpretable Deep Learning Model for Predicting RNA Subcellular Localization with domain-specific transfer-learning 97%
- Estimating the power of sequence covariation for detecting conserved RNA structure 94%
- DUETT quantitatively identifies known and novel events in nascent RNA structural dynamics from chemical probing data 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.