GLM-Prior: a nucleotide transformer model reveals prior knowledge as the driver of GRN inference performance
Gibbs, C. S.; Chen, A.; Bonneau, R.; Cho, K.
Show abstract
Gene regulatory network inference depends on high-quality prior knowledge, yet curated priors are often incomplete or unavailable across species and cell types. We present GLM-Prior, a genomic language model fine-tuned to predict transcription factor-target gene in-teractions directly from nucleotide sequence. We integrate GLM-Prior with PMF-GRN, a probabilistic matrix factorization model, to create a dual-stage pipeline that combines sequence-derived priors with single-cell gene expression data for GRN inference. Across six human, mouse, and yeast cell lines, GLM-Prior performance scales with positive label abundance and diverse transcription factor coverage, achieving strong accuracy in well-annotated mammalian contexts. We evaluate single-species, species-transfer learning, and multi-species training paradigms and show that GLM-Prior generalizes to held-out gene and TF sequences, enabling experiment-agnostic prior construction in previously unprofiled contexts. Furthermore, comparisons to accessibility-based priors across multiple GRN inference methods show that GLM-Prior provides the most robust priors in mammalian cell lines. Together, our results demonstrate that prior construction, rather than the choice of GRN inference algorithm, is the primary determinant of GRN inference performance, and establish GLM-Prior as a framework for building high-quality, experiment-agnostic priors that can be deployed even in understudied or experimentally inaccessible systems.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- NetTIME: a multitask and base-pair resolution framework for improved transcription factor binding site prediction 96%
- GRNFomer: Accurate Gene Regulatory Network Inference Using Graph Transformer 96%
- Inferring TF activities and activity regulators from gene expression data with constraints from TF perturbation data 96%
Similar papers in this journal
- Biologically-relevant transfer learning improves transcription factor binding prediction 96%
- Correcting gradient-based interpretations of deep neural networks for genomics 96%
- EvoAug: improving generalization and interpretability of genomic deep neural networks with evolution-inspired data augmentations 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.