SpatialFinder: A Human-in-the-Loop Vision-Language Framework for Prioritizing High-Value Regions in Spatial Transcriptomics
Xu, J.; Jiang, M.; Koga, S.; Zhang, N.; Huang, Z.
Show abstract
Sequencing an entire spatial transcriptomics slide can cost thousands of dollars per assay, making routine use impractical. Focusing on smaller regions of interest (ROIs) based on adjacent routine H&E slides offers a practical alternative, but there is (i) no reliable way to identify the most informative areas from standard H&E images alone; and (ii) limited solutions for clinicians to prioritize the microenvironment of their own interests. Here we introduce SpatialFinder, a framework that combines a biomedical vision-language model (VLM) with a human-in-the-loop optimization pipeline to predict gene expression heterogeneity and rank high-value ROIs across routine H&E tissue slides. Evaluated across four Visium HD tissue types, SpatialFinder consistently outperforms baseline VLMs in selecting regions with high cellular diversity and tumor presence, achieving up to 89% correlation with ground truth rankings. These results demonstrate the potential of human-AI collaboration to make spatial transcriptomics more cost-effective and clinically actionable.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Learning tissue representation by identification of persistent local patterns in spatial omics data 97%
- stLearn: integrating spatial location, tissue morphology and gene expression to find cell types, cell-cell interactions and spatial trajectories within undissociated tissues 97%
- Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST 96%
Similar papers in this journal
Similar papers in this journal
- A systematic evaluation of computational methods for cell segmentation 95%
- SHEST: Single-cell-level artificial intelligence from haematoxylin and eosin morphology for cell type prediction and spatial transcriptomics reconstruction 95%
- SpaTM: Topic Models for Inferring Spatially Informed Transcriptional Programs 95%
Similar papers in this journal
- Accurate single-molecule spot detection for image-based spatial transcriptomics with weakly supervised deep learning 96%
- Scalable image-based visualization and alignment of spatial transcriptomics datasets 96%
- Automated assignment of cell identity from single-cell multiplexed imaging and proteomic data 95%
Similar papers in this journal
- Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning 98%
- BayesSpace enables the robust characterization of spatial gene expression architecture in tissue sections at increased resolution 96%
- Density-Preserving Data Visualization Unveils Dynamic Patterns of Single-Cell Transcriptomic Variability 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.