Back

ORAKLE: Optimal Risk prediction for mAke30 in patients with acute Kidney injury using deep LEarning

Oh, W.; Veshtaj, M.; Sawant, A.; Agrawal, P.; Gomez, H.; Suarez-Farinas, M.; Oropello, J.; Kohli-Seth, R.; Kashani, K.; Kellum, J. A.; Nadkarni, G. N.; Sakhuja, A.

2025-01-19 intensive care and critical care medicine
10.1101/2025.01.18.25320769 medRxiv
Show abstract

BackgroundMajor Adverse Kidney Events within 30 days (MAKE30) is an important patient-centered outcome for assessing the impact of acute kidney injury (AKI). The existing prediction models for MAKE30 are static and overlook dynamic changes in clinical status. In this study, we introduce ORAKLE, a novel deep-learning model that utilizes evolving time-series data to predict MAKE30, enabling personalized, patient-centered approaches to AKI management and outcome improvement. MethodsWe conducted a retrospective study using three publicly available critical care databases: MIMIC-IV, SICdb, and eICU-CRD. Among these, MIMIC-IV was divided into 80% training and 20% internal test sets, whereas SiCdb and eICU-CRD were used as external validation cohorts. Patients with sepsis-3 criteria who developed AKI within 48 hours of intensive care unit admission were identified. Our primary outcome was MAKE30, defined as a composite of death, new dialysis or persistent kidney dysfunction within 30 days of ICU admission. We developed ORAKLE using Dynamic DeepHit framework for time-series survival analysis and its performance against Cox models using AUROC and AUPRC. We further assessed model calibration using Brier score. ResultsWe analyzed 16,671 patients from MIMIC-IV, 2,665 from SICdb, and 11,447 from eICU-CRD. ORAKLE outperformed the Cox models in predicting MAKE30, achieving AUROCs of 0.84 (95% CI: 0.83-0.86) vs. in MIMIC-IV internal test set 0.80 (95% CI: 0.78-0.82), 0.83 (95% CI: 0.81-0.85) vs. 0.79 (95% CI: 0.77-0.81) in SICdb, and 0.85 (95% CI: 0.84-0.85) vs. 0.81 (95% CI: 0.80-0.82) in eICU-CRD. The AUPRC values for ORAKLE were also significantly better than that of Cox models. The Brier score for ORAKLE was 0.21 across the internal test set, SICdb, and eICU-CRD, suggesting good calibration. ConclusionsORAKLE is a robust deep-learning model for predicting MAKE30 in critically ill patients with AKI that utilizes evolving time series data. By incorporating dynamically changing time series features, the model captures the evolving nature of kidney injury, treatment effects, and patient trajectories more accurately. This innovation facilitates tailored risk assessments and identifies varying treatment responses, laying the groundwork for more personalized and effective management approaches.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Scientific Reports
3102 papers in training set
Top 2%
14.3%
2
eBioMedicine
130 papers in training set
Top 0.1%
14.3%
3
PLOS ONE
4510 papers in training set
Top 25%
6.8%
4
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.5%
6.3%
5
BMC Medical Informatics and Decision Making
39 papers in training set
Top 0.6%
4.8%
6
Clinical Chemistry
22 papers in training set
Top 0.1%
4.3%
50% of probability mass above
7
Journal of Biomedical Informatics
45 papers in training set
Top 0.4%
4.2%
8
BMC Medicine
163 papers in training set
Top 1%
3.6%
9
Bioinformatics
1061 papers in training set
Top 5%
3.6%
10
npj Digital Medicine
97 papers in training set
Top 2%
2.1%
11
Frontiers in Medicine
113 papers in training set
Top 3%
2.1%
12
Kidney360
22 papers in training set
Top 0.3%
1.9%
13
JMIR Public Health and Surveillance
45 papers in training set
Top 1%
1.9%
14
JAMIA Open
37 papers in training set
Top 0.8%
1.7%
15
Biology Methods and Protocols
53 papers in training set
Top 1%
1.5%
16
JAMA Network Open
127 papers in training set
Top 3%
1.5%
17
Critical Care Explorations
15 papers in training set
Top 0.3%
1.5%
18
European Respiratory Journal
54 papers in training set
Top 1%
1.2%
19
PLOS Computational Biology
1633 papers in training set
Top 20%
1.1%
20
Critical Care
14 papers in training set
Top 0.5%
0.8%
21
Pediatric Research
18 papers in training set
Top 0.4%
0.7%
22
Frontiers in Physiology
93 papers in training set
Top 6%
0.7%
23
Journal of Stroke and Cerebrovascular Diseases
12 papers in training set
Top 0.6%
0.6%
24
Transplantation
13 papers in training set
Top 0.5%
0.6%
25
Frontiers in Molecular Biosciences
100 papers in training set
Top 6%
0.6%