A Neural Model of RNA Splicing: Learning Motif Distances with Self-Attention and Toeplitz Max Pooling
Quinn, T. P.; Nguyen, D.; Gupta, S.; Venkatesh, S.
Show abstract
Alternative RNA splicing is an important regulator of tissue development and specificity, and a relevant mechanism in cancer progression. There exists a strong motivation to disentangle the rules that govern RNA splicing, in part because this knowledge may one day yield new clinically relevant diagnostic tools and therapeutics. It is no easy to task to reverse engineer how the splicesome machinery choreographs the removal and addition of RNA elements following transcription. Here, we propose an interpretable neural network called the Toeplitz ATtention Architecture (TATA), which learns distance-dependent motif interactions through a novel Toeplitz max pool layer that captures the relative distance between interacting CNN filters. TATA is a completely transparent "clear-box" solution: every model parameter is human-interpretable. We validate TATA on simulated data, then apply it to real data to identify putative cis-regulatory elements that interact with primary RNA splice sites.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- PandoGen: Generating complete instances of future SARS-CoV-2 sequences using Deep Learning 96%
- Representation Learning of Genomic Sequence Motifs with Convolutional Neural Networks 95%
- Improving deep models of protein-coding potential with a Fourier-transform architecture and machine translation task 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.