Perturbation-aware predictive modeling of RNA splicing using bidirectional transformers
McNally, C. P.; Abdulhay, N. J.; Khalaj, M.; Saberi, A.; Zaro, B. W.; Goodarzi, H.; Ramani, V.
Show abstract
Predicting molecular function directly from DNA sequence remains a grand challenge in computational and molecular biology. Here, we engineer and train bidirectional transformer models to predict the chemical grammar of alternative human mRNA splicing leveraging the largest perturbative full-length RNA dataset to date. By combining high-throughput single-molecule long-read "chemical transcriptomics" in human cells with transformer models, we train AllSplice - a nucleotide foundation model that achieves state-of-the-art prediction of canonical and noncanonical splice junctions across the human transcriptome. We demonstrate improved performance achieved through incorporation of diverse noncanonical splice sites in its training set that were identified through long-read RNA data. Leveraging chemical perturbations and multiple cell types in the data, we fine-tune AllSplice to train ChemSplice - the first predictive model of sequence-dependent and cell-type specific alternative splicing following programmed cellular perturbation. We anticipate the broad application of AllSplice, ChemSplice, and other models fine-tuned on this foundation to myriad areas of RNA therapeutics development.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.