A Two-Stage Multimodal Contrastive Framework for PET-Based Prediction of Obstructive Coronary Artery Disease
Mostafavi, S.; Shanbhag, A.; Ramirez, G.; Lemley, M.; Miller, R. J. H.; Chareonthaitawee, P.; Liang, J. X.; Dey, D.; Kavanagh, P. B.; Slipczuk, L.; Travin, M. I.; Alexanderson, E.; Carvajal Juarez, I.; Packard, R. R.; Al-Mallah, M. H.; Einstein, A. J.; Ruddy, T. D.; deKemp, R. A.; Boczar, K.; Feher, A.; Buechel, R. R.; Acampa, W.; Knight, S.; Le, V. T.; Rosamond, T. L.; Berman, D. S.; Di Carli, M. F.; Slomka, P.
Show abstract
Background: Positron emission tomography (PET) myocardial perfusion imaging (MPI) provides complementary information on perfusion, myocardial blood flow and ventricular function. While these markers are often considered collectively during interpretation, their quantitative integration with imaging and clinical data into a unified predictive framework remains limited. We developed a multimodal artificial intelligence framework that combines PET polar maps with quantitative imaging and clinical features to improve obstructive coronary artery disease (CAD) detection. Methods: We retrospectively analyzed the multicenter REFINE PET registry. Among 38,682 PET MPI studies from 14 sites, 2,833 patients without known prior CAD underwent invasive coronary angiography within 180 days. Obstructive CAD was defined as >=50% left main stenosis or >=70% stenosis in other major epicardial coronary arteries. We developed a two-stage contrastive learning framework to learn multimodal PET representations from studies without angiographic labels and transfer them to supervised CAD prediction. In Stage 1, PET image and tabular encoders were pretrained on 12,225 PET MPI studies from eight development sites using 15-channel PET polar maps, quantitative PET perfusion, flow and gated functional measures, and clinical variables. In Stage 2, the pretrained encoders and a lightweight classification head were fine-tuned in 968 angiography-labeled patients, using lower encoder learning rates to limit overfitting. The model was externally validated for angiographically defined obstructive CAD detection in 1,865 patients from six independent sites and compared with standard PET MPI metrics. Results: The prevalence of obstructive CAD was 60% in the training cohort (66% male, median age of 70 years [63, 77]), and 55% in the external validation cohort (64% male, median age of 67 years [60-74]). In external validation, the AI model achieved an AUC of 0.85 (95% confidence interval (CI), 0.83-0.87) for obstructive CAD detection and outperformed conventional quantitative PET metrics (all P < 0.001). At a specificity matched to visual summed stress score, the AI model achieved higher sensitivity (89% [95% CI, 87-91] versus 85% [95% CI, 82-87]) and negative predictive value (81% [95% CI, 77-84] versus 73% [95% CI, 69-77]; both p<0.001). The overall net reclassification improvement was 8.9% (95% CI, 4.2-13.6%; p = 0.001). Conclusions: Multimodal contrastive pretraining improved obstructive CAD detection from PET imaging beyond conventional perfusion-based scoring in independent multisite external validation.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Opportunistic Assessment of Ischemic Heart Disease Risk Using Abdominopelvic Computed Tomography and Medical Record Data: a Multimodal Explainable Artificial Intelligence Approach 95%
- AngioNet: A Convolutional Neural Network for Vessel Segmentation in X-ray Angiography 93%
- Dual Adversarial Deconfounding Autoencoder for joint batch-effects removal from multi-center and multi-scanner radiomics data 92%
Similar papers in this journal
- From Community Acquired Pneumonia to COVID-19: A Deep Learning Based Method for Quantitative Analysis of COVID-19 on thick-section CT Scans 90%
- Evaluating Large Language Model-Generated Brain MRI Protocols: Performance of GPT4o, o3-mini, DeepSeek-R1 and Qwen2.5-72B 90%
- A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19) 89%
Similar papers in this journal
- Weakly supervised classification of rare aortic valve malformations using unlabeled cardiac MRI sequences 91%
- Clinically Applicable Deep Learning for Intracranial Aneurysm Detection in Computed Tomography Angiography Images: A Comprehensive Multicohort Study 91%
- EchoFM: A Pre-training and Fine-tuning Framework for Echocardiogram Videos Vision Foundation Model 91%
Similar papers in this journal
- A novel model to quantify blood transit time in cerebral arteries using ASL-based 4D magnetic resonance angiography with example clinical application in moyamoya disease 90%
- Early stopping in clinical PET studies: how to reduce expense and exposure 89%
- 2-deoxy-D-glucose chemical exchange-sensitive spin-lock MRI of cerebral glucose metabolism after stroke in the rat 89%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.