Parnet: A Clip-Seq-Based Foundation Model For RNA Sequence Representation Learning
Moyon, L.; Tirabassi, A.; Baranowskii, A.; Capitanchik, C.; Kuret Hodnik, K.; Wilkinson, L.; Londhe, S.; Dumbovic, G.; Gagneur, J.; Ule, J.; Horlacher, M.; Marsico, A.
Show abstract
RNA-binding proteins (RBPs) orchestrate a complex combinatorial regulatory "code" that governs RNA splicing, stability, localization, and translation. Learning the relationship between RNA sequences and these processes is a central challenge in genomics. Foundation models, notably RNA language models, have emerged as the dominant approach, learning general-purpose representations from unlabeled sequence at scale. While RNA language models have demonstrated impressive performance across a broad range of downstream tasks, they generally learn from sequence reconstruction objectives alone, lacking direct connections to the regulatory principles that govern RNA function. Here we introduce Parnet, an RNA foundation model trained directly and exclusively on experimental CLIP-seq data. Parnet is a multi-task foundation model trained end-to-end on 223 eCLIP-seq experiments spanning 150 RBPs to predict base-resolution RBP binding profiles directly from RNA sequence. This CLIP-seq pretraining strategy departs fundamentally from the masked-language-modeling paradigm, anchoring learned RNA representations directly in measured protein-RNA interactions rather than sequence statistics. Parnet substantially outperforms its single-task predecessor RBPNet in binding profile and motif recovery, generalizes to unseen cell types and iCLIP data, and recapitulates position-dependent splicing regulation. Frozen Parnet embeddings, without task-specific fine-tuning, match or exceed the performance of both task-specific tools, as well as larger self-supervised RNA and genomic language models across diverse downstream tasks, including RNA biotype classification, lncRNA chromatin localization, translational efficiency, splice-site recognition, intron retention, and non-coding variant effect prediction. Importantly, Parnet remains mechanistically interpretable, tracing predictions back to the specific RBPs and motifs that drive them. These results establish the RBP interactome as a compact, functionally sufficient, and interpretable basis for foundation model pretraining in RNA biology.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory Hierarchies 97%
- Dissecting splicing decisions and cell-to-cell variability with designed sequence libraries 96%
- Single-Cell Omics for Transcriptome CHaracterization (SCOTCH): isoform-level characterization of gene expression through long-read single-cell RNA sequencing 96%
Similar papers in this journal
- Massively Parallel Dissection of RNA in RNA-protein interactions in vivo 97%
- Rational design of mechanically active RNAs: de novo engineering of functional exoribonuclease-resistant RNAs 95%
- Massively parallel reporter assay-informed modeling improves prediction of context-specific enhancer-gene regulatory interactions 95%
Similar papers in this journal
- EvoRMD: Integrating Biological Context and Evolutionary RNA Language Models for Interpretable Prediction of RNA Modifications 98%
- RADAR: annotation and prioritization of variants in the post-transcriptional regulome of RNA-binding proteins 96%
- HydraRNA: a hybrid architecture based full-length RNA language model 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.