Computer Vision Methods for Spatial Transcriptomics: A Survey
Zhu, J.; Deng, R.; Guo, J.; Yao, T.; Lu, S.; Qu, C.; Xiong, J.; Zhu, Y.; Lu, Z.; Yang, Y.; Lionts, M.; Tang, Y.; Xu, D.; Wang, Y.; Zhao, S.; Yang, H.; Huo, Y.
Show abstract
Spatial transcriptomics (ST) enables the simultaneous measurement of gene expression and spatial localization within tissue sections, providing unprecedented opportunities to dissect tissue architecture and functional organization. As a relatively new omics technology, bioinformatics has driven much of the innovation in ST. However, within these frameworks, "spatial" information is often reduced to locations and relationships between molecular profiles, without fully leveraging the wealth of submicron morphological detail and histological knowledge available. Advances in computer vision-based artificial intelligence (AI) are opening exciting new avenues beyond conventional bioinformatics approaches by modeling complex histological patterns and linking morphology to molecular states. More excitingly, they bring fresh perspectives to potentially address key limitations of ST, including its high cost, limited clinical applicability, and reliance on twodimensional (2D) analysis of inherently three-dimensional (3D) tissues. For instance, models that predict ST directly from histology images enable "virtual sequencing," drastically reducing costs while integrating morphological insights from pathology with molecular biomarkers, thus accelerating clinical translation. Moreover, computer vision techniques can reconstruct pixel-aligned 3D tissue models, overcoming the technical barriers of 2D acquisition and advancing 3D spatial omics analytics. In this paper, we present the first systematic survey of computer vision AI models for ST analytics, categorizing approaches across architectures, learning paradigms, tasks, and datasets, and tracing their technological evolution. We highlight key challenges and future directions, offering a panoramic perspective on vision-driven ST and its potential to transform both basic research and clinical practice. The curated collection of vision-driven spatial transcriptomics papers is available at https://github.com/hrlblab/computer_vision_spatial_omics.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Graph Contrastive Learning of Subcellular-resolution Spatial Transcriptomics Improves Cell Type Annotation and Reveals Critical Molecular Pathways 95%
- A comprehensive comparison on cell type composition inference for spatial transcriptomics data 95%
- Spatial Transcriptomics Prediction from Histology jointly through Transformer and Graph Neural Networks 95%
Similar papers in this journal
Similar papers in this journal
- Imputation of Spatially-resolved Transcriptomes by Graph-regularized Tensor Completion 93%
- A Deep Learning approach for time-consistent cell cycle phase prediction from microscopy data 93%
- Highly Accurate Cancer Phenotype Prediction with AKLIMATE, a Stacked Kernel Learner Integrating Multimodal Genomic Data and Pathway Knowledge 93%
Similar papers in this journal
- MOH: a novel multilayer multi-omics heterogeneous graph for single-cell clustering 93%
- pathCLIP: Detection of Genes and Gene Relations from Biological Pathway Figures through Image-Text Contrastive Learning 93%
- GREMI: an Explainable Multi-omics Integration Framework for Enhanced Disease Prediction and Module Identification 92%
Similar papers in this journal
- GROTIA: An Interpretable Graph-Regularized Optimal TransportFramework for Diagonal Single-Cell IntegrativeAnalysis 93%
- ChronoRoot: High-throughput phenotyping by deep segmentation networks reveals novel temporal parameters of plant root system architecture 92%
- RootNav 2.0: Deep Learning for Automatic Navigation of Complex Plant Root Architectures 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.