His-MMDM: Multi-domain and Multi-omics Translation of Histopathology Images with Diffusion Models
Li, Z.; Su, T.; Zhang, B.; Han, W.; Zhang, S.; Sun, G.; Cong, Y.; Chen, X.; Qi, J.; Wang, Y.; Zhao, S.; Meng, H.; Liang, P.; Gao, X.
Show abstract
Generative AI (GenAI) has advanced computational pathology through various image translation models. These models synthesize histopathological images from existing ones, facilitating tasks such as color normalization and virtual staining. Current models, while effective, are mostly dedicated to specific source-target domain pairs and lack scalability for multi-domain translations. Here we introduce His-MMDM, a diffusion model-based framework enabling multi-domain and multi-omics histopathological image translation. His-MMDM is not only effective in performing existing tasks such as transforming cryosectioned images to FFPE ones and virtual immunohistochemical (IHC) staining but can also facilitate knowledge transfer between different tumor types and between primary and metastatic tumors. Additionally, it performs genomics-and/or transcriptomics-guided editing of histopathological images, illustrating the impact of driver mutations and oncogenic pathway alterations on tissue histopathology and educating pathologists to recognize them. These versatile capabilities position His-MMDM as a versatile tool in the GenAI toolkit for future pathologists.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration 98%
- INSTINCT: Multi-sample integration of spatial chromatin accessibility sequencing data via stochastic domain translation 97%
- OmicVerse: A single pipeline for exploring the entire transcriptome universe 96%
Similar papers in this journal
- Predicting MammaPrint Recurrence Risk from Breast Cancer Pathological Images Using a Weakly Supervised Transformer 98%
- DeDoc2 identifies and characterizes the hierarchy and dynamics of chromatin TAD-like domains in the single cells 95%
- Hierarchical prediction and perturbation of chromatin organization reveal how loop domains mediate higher-order architectures 95%
Similar papers in this journal
- Predicting Gene Spatial Expression and Cancer Prognosis: An Integrated Graph and Image Deep Learning Approach Based on HE Slides 96%
- Cell states and neighborhoods in distinct clinical stages of primary and metastatic esophageal adenocarcinoma 95%
- TimiGP: inferring inter-cell functional interactions and clinical values in the tumor immune microenvironment through gene pairs 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.