H2O: A Foundation Model Bridging Histopathology to Spatial Multi-Omics Profiling
Gu, Y.; Wu, Z.; Yan, R.; Wang, Z.; Li, Y.; Lin, S.; Cui, Y.; Lai, H.; Luo, X.; Zhou, S. K.; Yuan, Z.; Yao, J.
Show abstract
Spatial omics technologies have revolutionized the molecular profiling of tissues but remain constrained by high costs and limited scalability. While hematoxylin and eosin (H&E) staining is ubiquitous, it lacks molecular specificity. Here, we present H2O (Histopathology to Omics), a generalist AI framework that bridges the modality gap between histopathology and spatial multi-omics, enabling the direct inference of spatial transcriptomics (ST) and proteomics (SP) landscapes from routine H&E images. H2O integrates Vision Transformers (ViT) with Large Language Models (LLM) via contrastive learning to align histological morphology with semantic molecular knowledge. This cross-modal approach allows the model to incorporate spatial expression profiles into histological pattern recognition, effectively decoding the molecular heterogeneity underlying tissue morphology. Trained on a pan-tissue dataset of 1.3 million paired H&E-spatial patches across 25 organs and cancer types, H2O predicts spatial omics expression from histology with high concordance to sequenced measurements and consistently outperforms state-of-the-art models across three cancer benchmarks. Notably, H2O recovers the MIF-CD74/CD44 signaling axis directly from H&E images, highlighting its capacity to infer biologically meaningful cell-cell communication without molecular profiling. Applying on three additional public cohorts covering fetal and paediatric thymus tissues, human metastatic lymph node, and breast cancer, encompassing human development, 3D spatial frameworks, and integrative multi-omics, H2O yields biologically concordant insights, demonstrating superior accuracy, robustness, and generalizability across real-world applications in diverse scenarios. H2O converts routine histopathology into a portal for spatially resolved multi-omics profiling by computationally generating transcriptomic and proteomic landscapes, thereby enhancing tissue phenotyping and enabling scalable, integrative tissue-atlas construction.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- scMODAL: A general deep learning framework for comprehensive single-cell multi-omics data alignment with feature links 98%
- uniPort: a unified computational framework for single-cell data integration with optimal transport 97%
- Probabilistic embedding, clustering, and alignment for integrating spatial transcriptomics data with PRECAST 97%
Similar papers in this journal
- scCausalVI disentangles single-cell perturbation responses with causality-aware generative model 96%
- Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states 96%
- Automated assignment of cell identity from single-cell multiplexed imaging and proteomic data 95%
Similar papers in this journal
- Construction of a 3D whole organism spatial atlas by joint modeling of multiple slices 96%
- Inferring spatial single-cell-level interactions through interpreting cell state and niche correlations learned by self-supervised graph transformer 96%
- INSCT: Integrating millions of single cells using batch-aware triplet neural networks 96%
Similar papers in this journal
- Predicting MammaPrint Recurrence Risk from Breast Cancer Pathological Images Using a Weakly Supervised Transformer 96%
- Information-Distilled Generative Label-Free Morphological Profiling Encodes Cellular Heterogeneity 95%
- Hierarchical prediction and perturbation of chromatin organization reveal how loop domains mediate higher-order architectures 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.