An interpretable cell-centric representation of pancreatic ductal adenocarcinoma matches multiple-instance learning for clinical outcomes and leads to novel pathologist-driven histological biomarkers
Pelloux, M.; Tran, C. T.; Baig, J.; Khellaf, A.; Huang, S. L.; Nguyen, O. T.; Batardiere, M.; Diwan, S.-S.; Yang, Z.; Li, J.-L.; Vu, V.; Roy, S. F.; Soucy, G.; Nguyen, B. N.; Tessier-Cloutier, B.; Hosseini, M. S.; Knapp, D. J.; Valmary-Degano, S.; Trinh, V. Q.
Show abstract
Current state of the art computational pathology foundation models attain satisfying accuracy most general pathology tasks including detection of pancreatic ductal adenocarcinoma (PDAC) but fail to provide sufficient explainability, operating as "black boxes". Some interpretability effort has been made, with models providing attention maps that project back on the slide the models high attended areas that pushed for the given prediction result, without further naming or reasoning explanation which can limit pathologists trust toward the prediction. We developed C3PRO, a cell-centric framework attempting to provide deeper understanding and explainability, by using embeddings extracted using a pathology foundation model, from cell centered tiles containing both the cell and its close neighborhood, which were then clustered into recurrent morphological phenotypes. A spatial graph was additionally constructed on top of the back-projected vocabulary to account for recurrent motifs. The evaluation of the model performance involved a cohort of 809 patients (825 diagnostic biopsies) using nested cross validation. C3PRO was benchmarked against four different multiple instance learning frameworks and achieved on-par performance for diagnostic (0.958 AUC), survival (0.617) and resectability (0.696) prediction, while providing additional insights compared to the strongest baseline models. Each clustered phenotype was probed and extracted as a representative tile mosaic and annotated by two expert pathologists, constituting a phenotype vocabulary available for statistical analysis. These phenotypes were scored by pathologists with physical brightfield microscopy and replicated the independent statistical significance impact on overall survival prediction from diagnostic biopsies.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Attention-based whole-slide image compression achieves pathologist-level pre-screening of multi-organ routine histopathology biopsies 94%
- Interpretable multimodal deep learning for real-time pan-tissue pan-disease pathology search on social media 94%
- Genomic Characterization of Lung Cancer in Never-Smokers Using Deep Learning 92%
Similar papers in this journal
- ROSIE: AI generation of multiplex immunofluorescence staining from histopathology images 94%
- Teacher-student collaborated multiple instance learning for pan-cancer PDL1 expression prediction from histopathology slides 93%
- Segmenting functional tissue units across human organs using community-driven development of generalizable machine learning algorithms 92%
Similar papers in this journal
- Redefining phenotypic intratumor heterogeneity of pancreatic ductal adenocarcinoma: a bottom-up approach 89%
- A digital score of peri-epithelial lymphocytic activity predicts malignant transformation in oral epithelial dysplasia 89%
- Topological Analysis of the Human Lymph Node Reticular Network Predicts Outcome in Breast Cancer 88%
Similar papers in this journal
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 94%
- Multiple instance learning with pathology foundation models effectively predicts kidney disease diagnosis and clinical classification 92%
- Spatial Transcriptomics Inferred from Pathology Whole-Slide Images Links Tumor Heterogeneity to Survival in Breast and Lung Cancer 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.