Data-driven Prediction of Fifteen-Year All-Cause Mortality among 2.3 Million Individuals in the VA
Dhaubhadel, S.; Cohn, J. D.; Bhattacharya, T.; Ribeiro, R. M.; Ganguly, K.; Hengartner, N. W.; Tate, J. P.; Costa, L.; Ho, Y.-L.; Cho, K.; Costa, L.; Beckham, J. C.; Kimbrel, N. A.; Justice, A. C.; McMahon, B. H.
Show abstract
We present a data-driven framework to predict 15-year all-cause mortality using outpatient administrative records for 2.3 million Veterans in the largest integrated U.S. healthcare system. Rather than relying on predefined clinical phenotypes, we used the 1,000 most common outpatient medical codes from each of three data types/modalities: ICD-9 (Dx), Current Procedural Terminology (CPT), and prescription drugs (Rx), encoded as binary features. Using these features, we trained three machine learning (ML) algorithms (logistic regression with lasso, random forest, and a 3-layered feed-forward neural network) to predict 15-year mortality risk. The features were also mapped to variables for the widely used Charlson Comorbidity Index (CCI), Elixhauser, and Veterans Aging Cohort Study (VACS) indices, refitted for 15-year mortality prediction, for baseline comparison. All our models significantly outperformed the widely used CCI, Elixhauser, and VACS indices, with C-statistics ranging from 0.82 to 0.84 versus 0.739 to 0.804 for the baselines. Relative improvements in C-statistics of our approach over the baselines were consistent across different subgroups (age groups of <65 years, those 65+years, Blacks, Hispanics, etc.) Our approach enabled the identification of high-impact predictors with clinical grounding , without requiring hand-curated phenotypes. Cardiovascular diseases and mental health diagnoses/treatments emerged as leading long-term mortality indicators. Using unsupervised ML techniques including PCA and K-means clustering, we associated interpretable patterns and complex interactions between diagnoses and treatments, highlighting comorbidities, disease trajectories, and healthcare utilization patterns. The ability to achieve the predictive performance and algorithmically detect such relationships purely from outpatient data supports the scalability and broad applicability of our framework. This framework not only improves mortality risk stratification over existing clinical indices, but also enables better understanding of how medical codes, regardless of category, interact to predict long-term outcomes.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Risk factors for severe COVID-19 differ by age: a retrospective study of hospitalized adults 95%
- Personalized survival probabilities for SARS-CoV-2 positive patients by explainable machine learning 94%
- Using explainable machine learning to identify patients at risk of reattendance at discharge from emergency departments 94%
Similar papers in this journal
- Continuous-Time and Dynamic Suicide Attempt Risk Prediction with Neural Ordinary Differential Equations 96%
- Novel clinical subphenotypes in COVID-19: derivation, validation, prediction, temporal patterns, and interaction with social determinants of health 95%
- Clinical Knowledge Extraction via Sparse Embedding Regression (KESER) with Multi-Center Large Scale Electronic Health Record Data 94%
Similar papers in this journal
- Automated Interpretable Discovery of Heterogeneous Treatment Effectiveness: A Covid-19 Case Study 95%
- A scoping review of fair machine learning techniques when using real-world data 95%
- Natural language processing for scalable feature engineering and ultra-high-dimensional confounding adjustment in healthcare database studies 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.