Back

GLM-Prior: a nucleotide transformer model reveals prior knowledge as the driver of GRN inference performance

Gibbs, C. S.; Chen, A.; Bonneau, R.; Cho, K.

2025-07-04 genomics
10.1101/2025.06.29.662198 bioRxiv
Show abstract

Gene regulatory network inference depends on high-quality prior knowledge, yet curated priors are often incomplete or unavailable across species and cell types. We present GLM-Prior, a genomic language model fine-tuned to predict transcription factor-target gene in-teractions directly from nucleotide sequence. We integrate GLM-Prior with PMF-GRN, a probabilistic matrix factorization model, to create a dual-stage pipeline that combines sequence-derived priors with single-cell gene expression data for GRN inference. Across six human, mouse, and yeast cell lines, GLM-Prior performance scales with positive label abundance and diverse transcription factor coverage, achieving strong accuracy in well-annotated mammalian contexts. We evaluate single-species, species-transfer learning, and multi-species training paradigms and show that GLM-Prior generalizes to held-out gene and TF sequences, enabling experiment-agnostic prior construction in previously unprofiled contexts. Furthermore, comparisons to accessibility-based priors across multiple GRN inference methods show that GLM-Prior provides the most robust priors in mammalian cell lines. Together, our results demonstrate that prior construction, rather than the choice of GRN inference algorithm, is the primary determinant of GRN inference performance, and establish GLM-Prior as a framework for building high-quality, experiment-agnostic priors that can be deployed even in understudied or experimentally inaccessible systems.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.