A quantitative comparison between human experts and AI at estimating tumor-stroma ratio
Pai, A.; Brunekreef, J.; Marcus, E.; Sanders, J.; Guimaraes, M. D. S.; Menezes, R.; Sanchez, C. I.; Horlings, H. M.; Teuwen, J.
Show abstract
The tumor-stroma ratio (TSR) is an established prognostic biomarker across several cancer types, yet its manual assessment remains labour-intensive and subject to inter-observer variability. An artificial intelligence (AI)-based estimate could offer an efficient, consistent alternative for this task. In this study, quantitative comparisons were made between expert humans and an AI model for TSR estimation. Using two independent, multi-institutional histopathology datasets, an Attention U-Net was benchmarked against experienced pathologists. In a subset of the TCGA-BRCA dataset, the AI model demonstrated comparable trends to human consensus for TSR quantification, achieving an intraclass correlation coefficient (ICC) of 0.69. However, the AI models TSR scores are on average 5 percentage points higher compared to human scores on this dataset. The AI model was found to be more consistent at estimating TSR than either of the human counterparts, with a discrepancy ratio (DR) of 0.86. Results on an external dataset obtained from the Netherlands Cancer Institute consisting of cases (n=357) from 35 different Dutch hospitals showed that the AI models TSR scores are 7 percentage points lower on average compared to the human rater with an ICC of 0.59. To account for the models imperfect segmentation performance, we derived an estimate of the ambiguity in AI-based TSR predictions. The results indicate that, despite this ambiguity, the AI not only follows similar trends but also delivers greater overall scoring consistency than manual TSR assessment by humans.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- The Impact of Digital Histopathology Batch Effect on Deep Learning Model Accuracy and Bias 95%
- ROSIE: AI generation of multiplex immunofluorescence staining from histopathology images 94%
- Segmenting functional tissue units across human organs using community-driven development of generalizable machine learning algorithms 94%
Similar papers in this journal
- A tool for federated training of segmentation models on whole slide images. 95%
- Independent assessment of a deep learning system for lymph node metastasis detection on the Augmented Reality Microscope 93%
- Using an Anomaly Detection Approach for the Segmentation of Colorectal Cancer Tumors in Whole Slide Images 92%
Similar papers in this journal
- ViFIT-assisted Histopathology: From H&E Style Standardization to Virtual Fiber Image Transformation 94%
- Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning 94%
- Encrypted federated learning for secure decentralized collaboration in cancer image analysis 93%
Similar papers in this journal
- ARA: accurate, reliable and active histopathological image classification framework with Bayesian deep learning 95%
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 95%
- Spatial Transcriptomics Inferred from Pathology Whole-Slide Images Links Tumor Heterogeneity to Survival in Breast and Lung Cancer 94%
Similar papers in this journal
- A human-in-the-loop explanation framework for morphologically transparent AI predictions from whole-slide images 93%
- Understanding the robustness of vision-language models to medical image artefacts 92%
- STPath: A Generative Foundation Model for Integrating Spatial Transcriptomics and Whole Slide Images 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.