Immunotherapy Efficacy Prediction in Cancer: An Artificial Intelligence Approach with Unannotated H&E Whole-Slide Images
Dominguez Conde, G.; Qaiser, T.; Wu, E.; de Andrea, C. E.; Shields, J.; Artzi, R.; RaviPrakash, H.; Irabor, K.; Metcalfe, P.; Reischl, J.
Show abstract
Developing a solution to predict clinical outcomes for immunotherapy that is accurate, scalable, affordable, clinically meaningful, and globally accessible is an unmet medical need. Precise prediction of patient response to immunotherapy from pretreatment biopsy images will enable the delivery of immuno-oncology drugs to suitable patients and reduce the risk of administering unnecessary toxicity to patients who do not benefit from it. We propose an AI-based framework to produce stratifying algorithms that only need routinely obtained unannotated hematoxylin and eosin (H&E)-stained whole slide images. This design choice eliminates the need for pathologist annotations, ensuring affordability and scalability. Our solution, developed with data from 418 durvalumab patients, was validated both for head and neck squamous cell carcinoma and non-small cell lung cancer with data from 283 durvalumab patients, demonstrating its versatility and ease of adaptation for different indications. The results obtained using test data from clinical trials, different from training data, exhibit clinically meaningful improvement between those classified as positive and negative. For median overall survival (OS), the enhancement is in the range [55.9%, 198%] and [0.49, 0.70] for the hazard ratio for OS. For median progression-free survival (PFS), the improvement ranges within [39%, 195%], while the hazard ratio is within [0.46, 0.86] for PFS. Our solution complements the current biomarker, programmed death lig- and 1, for immunotherapy therapy, presenting an opportunity to develop more accurate solutions. In addition, as the algorithm was developed in a hypothesis-free approach, the analysis of the converged solution may enhance expert understanding of the pathomechanisms driving the response to immunotherapy. Its scalability and accuracy, combined with the AI-based engineering nature of the solution, bring the opportunity of being globally deployed using the cloud. Our technique has the potential to unlock opportunities not available for patients before by enabling the generation of efficient and affordable diagnoses for immunotherapy.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- The mathematics of erythema: Development of machine learning models for artificial intelligence assisted measurement and severity scoring of radiation induced dermatitis 95%
- Deep Multimodal Graph-Based Network for Survival Prediction from Highly Multiplexed Images and Patient Variables 95%
- BenchXAI: Comprehensive Benchmarking of Post-hoc Explainable AI Methods on Multi-Modal Biomedical Data 95%
Similar papers in this journal
Similar papers in this journal
- piNET: An Automated Proliferation Index Calculator Framework for Ki67 Breast Cancer Images 95%
- Breast invasive ductal carcinoma classification on whole slide images with weakly-supervised and transfer learning 94%
- Agent-Based Modeling of Virtual Tumors Reveals the Critical Influence of Microenvironmental Complexity on Immunotherapy Efficacy 94%
Similar papers in this journal
- Deep ensemble multitask classification of emergency medical call incidents combining multimodal data improves emergency medical dispatch 93%
- Stability of feature selection utilizing Graph Convolutional Neural Network and Layer-wise Relevance Propagation 93%
- Intrinsic-Dimension analysis for guiding dimensionality reduction and data fusion in multi-omics data processing 92%
Similar papers in this journal
- Annotation-Free Deep Learning for Predicting Gene Mutations from Whole Slide Images of Acute Myeloid Leukemia 96%
- Cancer drug sensitivity prediction from routine histology images 95%
- Cell graph neural networks enable the digital staging of tumor microenvironment and precise prediction of patient survival in gastric cancer 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.