Back

Prospective Evaluation of a 90-day Mortality Prediction Model: From Silent Pilots to Real Time Deployment in the EHR

Rossi, L. A.; Roberts, L. M.; Zachariah, F. J.

2023-01-28 health informatics
10.1101/2023.01.25.23284977 medRxiv
Show abstract

Prognostication in oncology is increasingly difficult due to the rapid evolution of therapies with significant improvement of survival. Accurate prognostication is essential to provide optimal, value-driven end of life care for cancer patients, and can promote goals of care (GOC) conversations with the potential to minimize chemotherapy or ICU utilization in the last weeks of life, and possibly increase hospice admission and length of stay.1 There are several recent publications on the application of machine learning for prognostication.2,3 We developed a 90-day mortality prediction model trained with data in the Electronic Health Records (EHR). After a non-interventional pilot stage, we deployed the model in February 2021 in the real-time Electronic Health Record Epic infrastructure of our cancer center. Here we present the model and evaluate its overall performance for the first 7.5 months since the go-live and outline our evaluation process for the next stages.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
JCO Clinical Cancer Informatics
18 papers in training set
Top 0.1%
28.7%
2
Cancer Medicine
24 papers in training set
Top 0.1%
7.4%
3
BMJ Health & Care Informatics
13 papers in training set
Top 0.1%
5.0%
4
Journal of Medical Internet Research
85 papers in training set
Top 0.9%
5.0%
5
npj Digital Medicine
97 papers in training set
Top 1.0%
4.5%
50% of probability mass above
6
Scientific Reports
3102 papers in training set
Top 33%
3.7%
7
JMIR Medical Informatics
17 papers in training set
Top 0.3%
3.7%
8
Frontiers in Digital Health
20 papers in training set
Top 0.3%
3.0%
9
The Lancet Digital Health
25 papers in training set
Top 0.2%
2.7%
10
iScience
1063 papers in training set
Top 8%
2.4%
11
International Journal of Medical Informatics
25 papers in training set
Top 0.7%
2.0%
12
BMC Medical Informatics and Decision Making
39 papers in training set
Top 1%
2.0%
13
Journal of the American Medical Informatics Association
61 papers in training set
Top 1%
2.0%
14
JAMIA Open
37 papers in training set
Top 0.8%
1.7%
15
PLOS Digital Health
91 papers in training set
Top 2%
1.5%
16
Informatics in Medicine Unlocked
21 papers in training set
Top 0.6%
1.4%
17
Biology Methods and Protocols
53 papers in training set
Top 2%
1.1%
18
JAMA
17 papers in training set
Top 0.2%
1.1%
19
Communications Medicine
85 papers in training set
Top 0.7%
0.9%
20
Bioinformatics
1061 papers in training set
Top 9%
0.8%
21
Frontiers in Artificial Intelligence
18 papers in training set
Top 0.6%
0.8%
22
JAMA Network Open
127 papers in training set
Top 4%
0.8%
23
Artificial Intelligence in Medicine
15 papers in training set
Top 0.6%
0.8%
24
eClinicalMedicine
55 papers in training set
Top 2%
0.8%
25
Journal of Personalized Medicine
28 papers in training set
Top 1%
0.8%
26
BMJ Open
554 papers in training set
Top 13%
0.7%
27
Nature Communications
4913 papers in training set
Top 65%
0.7%
28
European Respiratory Journal
54 papers in training set
Top 2%
0.7%
29
eBioMedicine
130 papers in training set
Top 6%
0.5%
30
JMIR Public Health and Surveillance
45 papers in training set
Top 5%
0.5%