Back

Decoding Synonymous Codon Selection With A Transformer Model

Bret, H.; Andre, I.

2026-03-31 bioinformatics
10.64898/2026.03.28.714798 bioRxiv
Show abstract

AO_SCPLOWBSTRACTC_SCPLOWThe genetic code is highly redundant, with many synonymous codons encoding the same amino acid. Codon usage influences RNA structure, signaling, and translation rates. Differences in tRNA availability modulate elongation, with rare codons slowing translation and affecting co-translational folding and gene expression. Despite their functional importance and non-random distribution, rare codons are underrepresented in natural datasets, restricting the development of predictive models. We developed a transformer-based model that predicts codon sequences from amino acids, substantially improving rare codon prediction. The model learns codon signatures encoding species identity, RNA thermodynamic properties, and elongation constraints without explicit labels. Attention analysis shows that codon choice depends on both short and long-range sequence contexts, recovering dicodon effects and highlighting additional motifs. Finally, predictions correlate with experimental measurements of the impact of synonymous mutations on protein fitness, linking gene sequence to fitness and functional consequences, providing a framework to connect sequence variation, translation, and protein function. O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=84 SRC="FIGDIR/small/714798v1_ufig1.gif" ALT="Figure 1"> View larger version (21K): org.highwire.dtl.DTLVardef@16fc387org.highwire.dtl.DTLVardef@8de223org.highwire.dtl.DTLVardef@f98c05org.highwire.dtl.DTLVardef@157a2ea_HPS_FORMAT_FIGEXP M_FIG C_FIG

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.