Segmentation Matters: Recognizing the Cell Segmentation Challenge in Spatial Transcriptomics
Yu, H.; Carroll, A. Y.; Shen, K.; Wu, N.; Yan, H.; Xiong, J.; Mercado, M. F.; Kaiser, E. A.; Gautam, M.; Li, M.; Luo, W.
Show abstract
Probe-based in situ hybridization spatial transcriptomics has emerged as a state-of-the-art for neuroscience research. Accurate segmentation of neurons and non-neuronal cells, a critical step for downstream analysis, remains a big challenge. Using human sensory ganglia neurons as an example, we systematically explore this problem. We evaluated multiple automatic segmentation approaches using quantitative performance metrics and downstream results. We show that careful parameter tuning is essential for achieving accurate segmentation; however, even with optimized parameters, different models still yield distinct classes of errors. To mitigate these errors, we propose a manual quality check, which can validate and refine automated segmentation results. As a future direction, integrating multi-modal imaging data with tailored neural networks may further improve segmentation accuracy. In summary, our results argue that each automated segmentation method has distinct strengths, weaknesses, and characteristic error patterns; and that a manual review is necessary.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST 97%
- Robust phenotyping of highly multiplexed tissue imaging data using pixel-level clustering 96%
- STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration 96%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.