Concurrent prediction of in-hospital mortality and length of stay using single-task, multi-class, and multi-task machine learning
Wei, J.; Gay, J.; Brent, A. J.; Clifton, D.; Walker, A. S.; Eyre, D. W.
Show abstract
BackgroundAccurate predictions of discharge timing and in-hospital mortality could improve hospital efficiency, but clinician estimates are often inconsistent and imprecise. We evaluated if machine learning models could concurrently predict in-hospital mortality and length of stay (LoS) more reliably. MethodsWe used electronic healthcare data from 01-November-2021 to 31-October-2024 from Oxfordshire, UK, using two years of data for training and evaluating models using the final years data. The performance of task-specific extreme gradient boosting (XGB), logistic regression (LR), and multilayer-perceptron (MLP) models for the two tasks: (i) mortality prediction and (ii) LoS prediction, were compared with that of a single multiclass XGB model predicting combinations of LoS and mortality, and an MLP-based multi-task learning model predicting both outcomes simultaneously. Predictions from the best-performing models were compared to discharge predictions made by clinicians. FindingsClinicians provided relevant discharge predictions for only 3-5% of admissions, mostly close to discharge. Task-specific XGB models achieved an area under the receiver operating curve of 0.92 and 0.92 for predicting mortality, and 0.83 and 0.72 for predicting LoS quartiles, in elective and emergency admissions respectively, outperforming task- specific LR and MLP models. Neither the multiclass XGB nor the MLP-based multi-task models, predicting both outcomes simultaneously, consistently improved performance. The best-performing task-specific XGB models matched clinician LoS prediction accuracy in elective admissions, and significantly outperformed clinicians in emergency admissions (p<0.001). InterpretationMachine learning models can predict in-hospital mortality and LoS as well or better than clinicians and have potential to enhance discharge planning and hospital resource management. FundingNational Institute for Health Research (NIHR) Biomedical Research Centre, Oxford, and NIHR Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Oxford University in partnership with the UK Health Security Agency (UKHSA).
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Using explainable machine learning to identify patients at risk of reattendance at discharge from emergency departments 96%
- Predicting bloodstream infection outcome using machine learning 95%
- Evaluation of Domain Generalization and Adaptation on Improving Model Robustness to Temporal Dataset Shift in Clinical Medicine 95%
Similar papers in this journal
- A comparison of machine learning models versus clinical evaluation for mortality prediction in patients with sepsis 95%
- Using patient biomarker time series to determine mortality risk in hospitalised COVID-19 patients: a comparative analysis across two New York hospitals 94%
- Development of a Risk Prediction Model for Sepsis-Related Delirium Based on Multiple Machine Learning Approaches and an Online Calculator 93%
Similar papers in this journal
- OASIS+: leveraging machine learning to improve the prognostic accuracy of OASIS severity score for predicting in-hospital mortality 94%
- Development and Validation of ‘Patient Optimizer’ (POP) Algorithms for Predicting Surgical Risk with Machine Learning 93%
- Development of a data-driven COVID-19 prognostication tool to inform triage and step-down care for hospitalised patients in Hong Kong: A population based cohort study 93%
Similar papers in this journal
- Community-acquired pneumonia identification from electronic health records in the absence of a gold standard: a Bayesian latent class analysis 93%
- Generalizability Challenges of Mortality Risk Prediction Models: A Retrospective Analysis on a Multi-center Database 93%
- Identification of physiological adverse events using continuous vital signs monitoring during paediatric critical care transport: a novel data-driven approach 93%
Similar papers in this journal
- Integration of clinical characteristics, lab tests and a deep learning CT scan analysis to predict severity of hospitalized COVID-19 patients 93%
- Deep representation learning for clustering longitudinal survival data from electronic health records 92%
- Deep phenotyping of 34,128 patients hospitalised with COVID-19 and a comparison with 81,596 influenza patients in America, Europe and Asia: an international network study 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.