ChromBERT-tools: A versatile toolkit for context-specific embedding of transcription regulators across different cell types
Chen, Q.; Yu, Z.; Zhang, Y.
Show abstract
MotivationRepresentations that capture the genome-wide context of transcription regulators are critical for establishing a shared backbone for flexible transcription modeling and in silico regulatory analysis. Yet, current embeddings predominantly rely on limited modalities, such as gene co-expression or static protein features, offering an incomplete perspective that ignores context-dependent transcription regulator activities across the genome. The lack of transcription regulation-informed embeddings, paired with the absence of a user-friendly and lightweight toolkit for their generation, adaption to different cell types and interpretation, impedes the capture of the regulatory logic that underpin cellular states and functions. ResultsTo address this need, we present ChromBERT-tools, a lightweight toolkit designed to operationalize regulation-informed embeddings derived from a foundation model pre-trained on the comprehensive landscapes of human and mouse transcription regulators. ChromBERT-tools provides user-friendly command-line interfaces (CLIs) and Python APIs to achieve two primary goals: (i) generating cell-type-agnostic embeddings that capture the semantic representations of individual regulators and their combinatorial interactions, serving as biological priors of transcription regulator modality to enhance transcription regulation modeling and rule interpretation; and (ii) generating cell-type-specific embeddings via fine-tuned model variants, which support in silico inference of regulatory roles of transcription regulators in cell types with scarce experimental data. The toolkit streamlines end-to-end workflows for embedding generation, adaption to different cell types and interpretation towards biological inferences such as regulator-regulator interaction across the genome and key regulators determining cell identity or cell state transition. Availability and implementationChromBERT-tools is freely available at https://github.com/TongjiZhanglab/ChromBERT-tools, with documentation at https://chrombert-tools.readthedocs.io/en/latest/.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A framework for summarizing chromatin state annotations within and identifying differential annotations across groups of samples 95%
- AdaLiftOver: High-resolution identification of orthologous regulatory elements with adaptive liftOver 95%
- Flashzoi: An enhanced Borzoi model for accelerated genomic analysis 95%
Similar papers in this journal
- Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states 94%
- Geometric Sketching Compactly Summarizes the Single-Cell Transcriptomic Landscape 93%
- Iterative deep learning-design of human enhancers exploits condensed sequence grammar to achieve cell type-specificity 93%
Similar papers in this journal
- Integrating convolution and self-attention improves language model of human genome for interpreting non-coding regions at base-resolution 96%
- Liam tackles complex multimodal single-cell data integration challenges 95%
- Developing a general AI model for integrating diverse genomic modalities and comprehensive genomic knowledge 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.