DeepSpot: Leveraging Spatial Context for Enhanced Spatial Transcriptomics Prediction from H&E Images
Nonchev, K.; Dawo, S.; Silina, K.; Moch, H.; Andani, S.; Tumor Profiler Consortium, ; Koelzer, V. H.; Raetsch, G.
Show abstract
Spatial transcriptomics technology remains resource-intensive and unlikely to be routinely adopted for patient care soon. This hinders the development of novel precision medicine solutions and, more importantly, limits the translation of research findings to patient treatment. Here, we present DeepSpot, a deep-set neural network that leverages recent foundation models in pathology and spatial multi-level tissue context to effectively predict spatial transcriptomics from standard H&E images. DeepSpot substantially improved gene correlations across multiple datasets from patients with metastatic melanoma, kidney, lung, or colon cancers as compared to previous state-of-the-art. Using DeepSpot, we generated 3,780 TCGA virtual spatial transcriptomics samples (56 million spots) of the melanoma, renal cell cancer, lung adenocarcinoma and lung squamous cell carcinoma cohorts. We anticipate this to be a valuable resource for biological discovery and a benchmark for evaluating spatial transcriptomics models. We hope that DeepSpot and this dataset will stimulate further advancements in virtual spatial transcriptomics analysis.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Probabilistic embedding, clustering, and alignment for integrating spatial transcriptomics data with PRECAST 97%
- uniPort: a unified computational framework for single-cell data integration with optimal transport 97%
- Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST 96%
Similar papers in this journal
- stGCL: A versatile cross-modality fusion method based on multi-modal graph contrastive learning for spatial transcriptomics 96%
- stDyer enables spatial domain clustering with dynamic graph embedding 95%
- scCross: A Deep Generative Model for Unifying Single-cell Multi-omics with Seamless Integration, Cross-modal Generation, and In-silico Exploration 95%
Similar papers in this journal
- MuCST: restoring and integrating heterogeneous morphology images and spatial transcriptomics data with contrastive learning 95%
- SpaPheno: Linking Spatial Transcriptomics to Clinical Phenotypes with Interpretable Machine Learning 95%
- LETSmix: a spatially informed and learning-based domain adaptation method for cell-type deconvolution in spatial transcriptomics 94%
Similar papers in this journal
- Identifying perturbations that boost T-cell infiltration into tumours via counterfactual learning of their spatial proteomic profiles 95%
- Ultra-fast Prediction of Somatic Structural Variations by Reduced Read Mapping via Pan-Genome k-mer Sets 94%
- Combinatorial prediction of therapeutic perturbations using causally-inspired neural networks 92%
Similar papers in this journal
- Hist2Cell: Deciphering Fine-grained Cellular Architectures from Histology Images 97%
- Unraveling Neuronal Identities Using SIMS: A Deep Learning Label Transfer Tool for Single-Cell RNA Sequencing Analysis 94%
- CellUntangler: separating distinct biological signals in single-cell data with deep generative models 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.