C.La.P.: Enhancing transformer-based genomic signal modeling by integrating DNA sequences and chromatin accessibility data
Firbas Nisantzis, P.; Goncalves, C.; de Polavieja, G.
Show abstract
Transformers have shown promise in chromatin modeling but have primarily relied solely on reference DNA sequences, limiting their utility across multiple biological contexts. In this work we enhance transformer models by integrating reference sequences with ATAC-seq, a chromatin accessibility assay. Our Chromatin LAnguage Processing (CLaP) model combines a convolutional tokenizer, a transformer encoder, and task-specific components to predict multiple genomic signals from a single input. After pre-training with masked nucleotide prediction, CLaP achieved per-token F1 scores exceeding 0.8 for three target ChIP-seq assays in fine-tuning. Attention mechanism analysis revealed that CLaP detects CTCF binding sites with nucleotide-level precision by learning the sequence preference of the CTCF factor and the characteristic ATAC-seq patterns that are caused by protein binding events. Additionally, CLaP predicts protein-DNA binding events not captured by the ChIP-seq ground truth. These findings highlight CLaPs potential to expand chromatin modeling by incorporating molecular assay data alongside sequence information.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A base-resolution panorama of the in vivo impact of cytosine methylation on transcription factor binding 97%
- Benchmarking DNA binding affinity models using allele-specific transcription factor binding data 96%
- Biologically-relevant transfer learning improves transcription factor binding prediction 96%
Similar papers in this journal
Similar papers in this journal
- NetTIME: a multitask and base-pair resolution framework for improved transcription factor binding site prediction 97%
- seqgra: Principled Selection of Neural Network Architectures for Genomics Prediction Tasks 96%
- preciseTAD: A transfer learning framework for 3D domain boundary prediction at base-pair resolution 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.