Back

An Ensemble Deep Learning Algorithm for Structural Heart Disease Screening Using Electrocardiographic Images: PRESENT SHD

Dhingra, L. S.; Aminorroaya, A.; Sangha, V.; Pedroso Camargos, A.; Vasisht Shankar, S.; Coppi, A.; Foppa, M.; Brant, L. C. C.; Barreto, S. M.; Ribeiro, A. L. P.; Krumholz, H.; Oikonomou, E. K.; Khera, R.

2024-10-07 cardiovascular medicine
10.1101/2024.10.06.24314939 medRxiv
Show abstract

BackgroundIdentifying structural heart diseases (SHDs) early can change the course of the disease, but their diagnosis requires cardiac imaging, which is limited in accessibility. ObjectiveTo leverage images of 12-lead ECGs for automated detection and prediction of multiple SHDs using an ensemble deep learning approach. MethodsWe developed a series of convolutional neural network models for detecting a range of individual SHDs from images of ECGs with SHDs defined by transthoracic echocardiograms (TTEs) performed within 30 days of the ECG at the Yale New Haven Hospital (YNHH). SHDs were defined as LV ejection fraction <40%, moderate-to-severe left-sided valvular disease (aortic/mitral stenosis or regurgitation), or severe left ventricular hypertrophy (IVSd > 1.5cm and diastolic dysfunction). We developed an ensemble XGBoost model, PRESENT-SHD, as a composite screen across all SHDs. We validated PRESENT-SHD at 4 US hospitals and the prospective, population-based Brazilian Longitudinal Study of Adult Health (ELSA-Brasil), with concurrent protocolized ECGs and TTEs. We also used PRESENT-SHD for risk stratification of new-onset SHD or heart failure (HF) in clinical cohorts and the population-based UK Biobank (UKB). ResultsThe models were developed using 261,228 ECGs from 93,693 YNHH patients and evaluated on a single ECG from 11,023 individuals at YNHH (19% with SHD), 44,591 across external hospitals (20-27% with SHD), and 3,014 in the ELSA-Brasil (3% with SHD). In the held-out test set, PRESENT-SHD demonstrated an AUROC of 0.886 (0.877-894), 90% sensitivity, and 66% specificity. At hospital-based sites, PRESENT-SHD had AUROCs ranging from 0.854-0.900, with sensitivities and specificities of 93-96% and 51-56%, respectively. The model generalized well to ELSA-Brasil (AUROC, 0.853 [0.811-0.897], 88% sensitivity, 62% specificity). PRESENT-SHD demonstrated consistent performance across demographic subgroups, novel ECG formats, and smartphone photographs of ECGs from monitors and printouts. A positive PRESENT-SHD screen portended a 2- to 4-fold higher risk of new-onset SHD/HF, independent of demographics, comorbidities, and the competing risk of death across clinical sites and UKB, with high predictive discrimination. ConclusionWe developed and validated PRESENT-SHD, an AI-ECG tool identifying a range of SHD using images of 12-lead ECGs, representing a robust, scalable, and accessible modality for automated SHD screening and risk stratification. CONDENSED ABSTRACTScreening for structural heart disorders (SHDs) requires cardiac imaging, which has limited accessibility. To leverage 12-lead ECG images for automated detection and prediction of multiple SHDs, we developed PRESENT-SHD, an ensemble deep learning model. PRESENT-SHD demonstrated excellent performance in detecting SHDs across 5 US hospitals and a population-based cohort in Brazil. The model successfully predicted the risk of new-onset SHD or heart failure in both US clinical cohorts and the community-based UK Biobank. By using ubiquitous ECG images and smartphone photographs to predict a composite outcome of multiple SHDs, PRESENT-SHD establishes a scalable paradigm for cardiovascular screening and risk stratification.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
European Heart Journal - Digital Health
15 papers in training set
Top 0.1%
40.6%
2
Frontiers in Cardiovascular Medicine
49 papers in training set
Top 0.4%
8.5%
3
npj Digital Medicine
97 papers in training set
Top 0.6%
8.5%
50% of probability mass above
4
Circulation
66 papers in training set
Top 0.8%
4.4%
5
Circulation: Genomic and Precision Medicine
42 papers in training set
Top 0.4%
3.7%
6
Scientific Reports
3102 papers in training set
Top 42%
3.0%
7
Journal of the American Heart Association
119 papers in training set
Top 2%
2.1%
8
European Heart Journal
16 papers in training set
Top 0.3%
1.9%
9
The American Journal of Cardiology
15 papers in training set
Top 0.8%
1.9%
10
PLOS ONE
4510 papers in training set
Top 52%
1.7%
11
The Lancet Digital Health
25 papers in training set
Top 0.4%
1.7%
12
Heart
10 papers in training set
Top 0.5%
1.7%
13
Journal of the American College of Cardiology
12 papers in training set
Top 0.5%
1.3%
14
BMC Cardiovascular Disorders
14 papers in training set
Top 1%
0.9%
15
Nature Communications
4913 papers in training set
Top 60%
0.8%
16
Medical Image Analysis
33 papers in training set
Top 0.9%
0.8%
17
JMIR Medical Informatics
17 papers in training set
Top 1%
0.8%
18
Frontiers in Physiology
93 papers in training set
Top 5%
0.8%
19
PLOS Digital Health
91 papers in training set
Top 3%
0.7%
20
BMC Medicine
163 papers in training set
Top 8%
0.7%
21
Computers in Biology and Medicine
120 papers in training set
Top 6%
0.5%
22
Genome Medicine
154 papers in training set
Top 10%
0.5%