A contextualised protein language model reveals the functional syntax of bacterial evolution
Wiatrak, M.; Vinas Torne, R.; Ntemourtsidou, M.; Dinan, A. M.; Abelson, D. C.; Arora, D.; Brbic, M.; Weimann, A.; Floto, R. A.
Show abstract
Bacteria have evolved a vast diversity of functions and behaviours which are currently incompletely understood and poorly predicted from DNA sequence alone. To understand the syntax of bacterial evolution and discover genome-to-phenotype relationships, we curated over 1.3 million genomes spanning bacterial phylogenetic space, representing each as an ordered sequence of proteins which collectively were used to train a transformer-based, contextualised protein language model, Bacformer. By pretraining the model to learn genome-wide evolutionary patterns, Bacformer captures the compositional and positional relationships of proteins and can accurately: predict protein-protein interactions, operon structure (which we validated experimentally), and protein function; infer phenotypic traits and identify likely causal genes; and design template synthethic genomes with desired properties. Thus, Bacformer represents a new foundation model for bacterial genomics that provide biological insights and a framework for prediction, inference, and generative tasks.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Uncovering 2-D toroidal representations in grid cell ensemble activity during 1-D behavior 96%
- Top-down perceptual inference shaping the activity of early visual cortex 95%
- Widespread transfer of mobile antibiotic resistance genes within individual gut microbiomes revealed through bacterial Hi-C 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.