DNT: Diploid Genomic Foundation Model
Leib, G.; Zinger, T.; Ofer, D.; Kellerman, R.; Nayshool, O.; Dominissini, D.; Larey, A.; Levy, J.; Nahshan, Y.; Dahan, E.; Bleiweiss, A.; Bussola, N.; Lee, S.; O'Connell, S.; Hoang, D.; Wirth, M.; Beckmann, N. D.; Charney, A. W.; Shavit, Y.; Daniel, N.; Rechavi, G.
Show abstract
Clinical interpretation of genetic variation depends on the diploid genotype, including zygosity, allele dosage and whether multiple variants occur in cis on the same homologue or in trans on different homologues. Most genomic language models process haploid sequences or combine independently encoded haplotypes downstream, so they do not directly represent the paired genotype in a single sequence. We introduce a reference-aligned diploid encoding for single-nucleotide variants (SNVs) and short insertions and deletions (indels), together with unphased and phase-retaining tokenizers that accept phased genotypes and convert them to single-sequence diploid representation. Using Nucleotide Transformer v3 backbones, we continue training 8-million- and 100-million-parameter models and evaluate an auxiliary Contrastive Phase Loss (CPL) designed to retain the phasing information of the variants in contextual representations. We evaluate on a novel compound-heterozygous benchmark containing 9,460 examples. Models whose inputs did not distinguish relative phase remained near chance, whereas our diploidic models improved discrimination with AUROC 0.649, compared to 0.506 for the vocabulary-adapted control. These findings establish a method for making diploid genotype information accessible to genomic language models, rather than a universal improvement in variant prediction; validation in naturally observed, accurately phased clinical cohorts remains necessary.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Fine-tuning sequence-to-expression models onpersonal genome and transcriptome data 94%
- Juggling offsets unlocks RNA-seq tools for fast scalable differential usage, aberrant splicing and expression analyses. 94%
- An open-source platform to distribute and interpret data from multiplexed assays of variant effect 94%
Similar papers in this journal
Similar papers in this journal
- Whole genome base-wise aggregation and functional prediction for human non-coding regulatory variants 94%
- Integrating convolution and self-attention improves language model of human genome for interpreting non-coding regions at base-resolution 94%
- Echtvar: Compressed variant representation for rapid annotation and filtering of SNPs and indels 94%
Similar papers in this journal
- OMKar: optical map based automated karyotyping of genomes to identify constitutional abnormalities 94%
- Whole-genome variant detection in long-read sequencing data from ultra-low input patient samples 94%
- Estimation of allele-specific fitness effects across human protein-coding sequences and implications for disease 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.