Accurate spatial quantification in computational pathology with multiple instance learning
Gao, Z.; Mao, A.; Dong, Y.; Wu, J.; Liu, J.; Wang, C.; He, K.; Gong, T.; Li, C.; Crispin-Ortuzar, M.
Show abstract
Spatial quantification is a critical step in most computational pathology tasks, from guiding pathologists to areas of clinical interest to discovering tissue phenotypes behind novel biomarkers. To circumvent the need for manual annotations, modern computational pathology methods have favoured multiple-instance learning approaches that can accurately predict whole-slide image labels, albeit at the expense of losing their spatial awareness. We prove mathematically that a model using instance-level aggregation could achieve superior spatial quantification without compromising on whole-slide image prediction performance. We then introduce a superpatch-based measurable multiple instance learning method, SMMILe, and evaluate it across 6 cancer types, 3 highly diverse classification tasks, and 8 datasets involving 3,850 whole-slide images. We benchmark SMMILe against 9 existing methods, and show that in all cases SMMILe matches or exceeds state-of-the-art whole-slide image classification performance while simultaneously achieving outstanding spatial quantification.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reports 95%
- Inferring spatial single-cell-level interactions through interpreting cell state and niche correlations learned by self-supervised graph transformer 94%
- COSIME: Cooperative multi-view integration with Scalable and Interpretable Model Explainer 94%
Similar papers in this journal
- Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimes 96%
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 95%
- Features fusion or not: harnessing multiple pathological foundation models using Meta-Encoder for downstream tasks fine-tuning 94%
Similar papers in this journal
- pathCLIP: Detection of Genes and Gene Relations from Biological Pathway Figures through Image-Text Contrastive Learning 94%
- A Transformer-Based Model Trained on Large Scale Claims Data for Prediction of Severe COVID-19 Disease Progression 93%
- GREMI: an Explainable Multi-omics Integration Framework for Enhanced Disease Prediction and Module Identification 92%
Similar papers in this journal
- Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning 95%
- Clinical Validation of Saliency Maps for Understanding Deep Neural Networks in Ophthalmology 94%
- A Framework for Falsifiable Explanations of Machine Learning Models with an Application in Computational Pathology 93%
Similar papers in this journal
- STPath: A Generative Foundation Model for Integrating Spatial Transcriptomics and Whole Slide Images 97%
- FedWeight: Mitigating Covariate Shift of Federated Learning on Electronic Health Records Data through Patients Re-weighting 96%
- Generation of realistic synthetic data using multimodal neural ordinary differential equations 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.