Topological Feature Extraction and Visualization of Whole Slide Images using Graph Neural Networks
Levy, J.; Haudenschild, C.; Bar, C.; Christensen, B.; Vaickus, L.
Show abstract
Whole-slide images (WSI) are digitized representations of thin sections of stained tissue from various patient sources (biopsy, resection, exfoliation, fluid) and often exceed 100,000 pixels in any given spatial dimension. Deep learning approaches to digital pathology typically extract information from sub-images (patches) and treat the sub-images as independent entities, ignoring contributing information from vital large-scale architectural relationships. Modeling approaches that can capture higher-order dependencies between neighborhoods of tissue patches have demonstrated the potential to improve predictive accuracy while capturing the most essential slide-level information for prognosis, diagnosis and integration with other omics modalities. Here, we review two promising methods for capturing macro and micro architecture of histology images, Graph Neural Networks, which contextualize patch level information from their neighbors through message passing, and Topological Data Analysis, which distills contextual information into its essential components. We introduce a modeling framework, WSI-GTFE that integrates these two approaches in order to identify and quantify key pathogenic information pathways. To demonstrate a simple use case, we utilize these topological methods to develop a tumor invasion score to stage colon cancer.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning 95%
- Encrypted federated learning for secure decentralized collaboration in cancer image analysis 95%
- A Framework for Falsifiable Explanations of Machine Learning Models with an Application in Computational Pathology 93%
Similar papers in this journal
- STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration 95%
- Segmenting functional tissue units across human organs using community-driven development of generalizable machine learning algorithms 95%
- Learning tissue representation by identification of persistent local patterns in spatial omics data 95%
Similar papers in this journal
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 96%
- Construction and optimization of multi-platform precision pathways for precision medicine 94%
- Spatial Transcriptomics Inferred from Pathology Whole-Slide Images Links Tumor Heterogeneity to Survival in Breast and Lung Cancer 94%
Similar papers in this journal
- STPath: A Generative Foundation Model for Integrating Spatial Transcriptomics and Whole Slide Images 94%
- Biologically-informed deep neural networks provide quantitative assessment of intratumoral heterogeneity in post-treatment glioblastoma 94%
- Understanding the robustness of vision-language models to medical image artefacts 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.