Back

Transcriptomics-Conditioned Virtual Tissue Synthesis via Diffusion Transformers

Vlachas, P.; Nonchev, K.; Koelzer, V.; Ratsch, G.

2026-05-29 bioinformatics
10.64898/2026.05.26.727902 bioRxiv
Show abstract

Spatial transcriptomics couples hematoxylin and eosin (H&E) tissue morphology with spatially resolved gene expression (GE). However, generative models that exploit this coupling to synthesize tissue images from transcriptomic profiles remain scarce. We present STMDiT (Spatial Transcriptomics and Morphology Diffusion Transformer), a diffusion transformer that synthesizes H&E histopathology patches conditioned jointly on morphological embeddings and transcriptomic profiles. Building on PixCell (Yellapragada et al., 2025), we integrate gene expression from a frozen CancerFoundation encoder (Theus et al., 2024) through adaptive layer normalization and per-block cross-attention, and we train under dual classifier-free guidance with independent modality dropout. On the 10x TuPro Visium melanoma cohort, GE conditioning improves both image quality over the no-GE PixCell-B baseline (best FID = 252.9 vs 330.7) and transcriptomic fidelity (best AUC = 0.267 vs 0.229, reaching 82% of the real-tile ceiling). Training with DeepSpots predicted-transcriptomics pseudo-labels (PTPL) uniquely transfers zero-shot to TCGA SKCM, an out-of-distribution (OOD) H&E-only melanoma cohort: PTPL-XAttn-PMA-B reaches FID = 690.0, a 57-point improvement over the no-GE baseline (747.1), with a within-model GE-ablation effect of {Delta}OOD = +309.5, enabling virtual tissue synthesis beyond native spatial-transcriptomics coverage. Our results indicate that gene-expression conditioning produces morphologically distinct tissue images and supports virtual tissue simulation for hypothesis testing in computational pathology.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Nature Machine Intelligence
70 papers in training set
Top 0.1%
15.5%
2
Nature Methods
385 papers in training set
Top 1%
8.1%
3
Bioinformatics
1204 papers in training set
Top 3%
8.1%
4
Nature Communications
5641 papers in training set
Top 22%
7.5%
5
Medical Image Analysis
35 papers in training set
Top 0.1%
6.9%
6
Nature Biomedical Engineering
47 papers in training set
Top 0.1%
5.7%
50% of probability mass above
7
npj Digital Medicine
118 papers in training set
Top 1%
3.6%
8
Briefings in Bioinformatics
354 papers in training set
Top 2%
3.5%
9
Nature Biotechnology
172 papers in training set
Top 2%
2.9%
10
eLife
5828 papers in training set
Top 40%
2.5%
11
Nature
645 papers in training set
Top 5%
2.5%
12
Scientific Reports
3612 papers in training set
Top 46%
2.2%
13
Advanced Science
286 papers in training set
Top 4%
2.2%
14
PLOS Computational Biology
1863 papers in training set
Top 13%
2.0%
15
Cell Reports Medicine
153 papers in training set
Top 2%
1.8%
16
Patterns
78 papers in training set
Top 2%
1.2%
17
Advanced Intelligent Systems
11 papers in training set
Top 0.2%
1.2%
18
Cell Reports Methods
165 papers in training set
Top 2%
1.2%
19
New Phytologist
346 papers in training set
Top 4%
1.2%
20
IEEE Transactions on Medical Imaging
21 papers in training set
Top 0.4%
1.0%
21
Science Advances
1243 papers in training set
Top 29%
1.0%
22
Computational and Structural Biotechnology Journal
242 papers in training set
Top 6%
0.9%
23
Cell Systems
201 papers in training set
Top 4%
0.9%
24
Genome Medicine
183 papers in training set
Top 5%
0.9%
25
Nucleic Acids Research
1281 papers in training set
Top 13%
0.9%
26
Communications Medicine
113 papers in training set
Top 4%
0.9%
27
Communications Biology
993 papers in training set
Top 33%
0.6%