Cross-site predictions of readmission after psychiatric hospitalization with mood or psychotic disorders
Ren, B.; Yoon, W.; Thomas, S.; Savova, G.; Miller, T.; Hall, M.-H.
Show abstract
Patients with mood or psychotic disorders have high rates of unplanned readmission, and predicting readmission likelihood may guide discharge decisions. In this retrospective, multi-site study, we assess the predictive power of various structured variables from electronic health records for all-cause readmission in each site separately and evaluate the generalizability of the in-site prediction models across sites. We find that the set of relevant predictors vary significantly across. For example, length of stay is strongly predictive of readmission at only three out of the four sites. We also find a general lack of cross-site generalizability of the in-site prediction models, with in-site predictions having an average F1 score of 0.666, compared to an average F1 score of 0.551 for cross-site predictions. The generalizability cannot be improved even after adjusting for differences in the distributions of predictors. These results indicate that, with this set of predictors, fitting individual models at each site is necessary to achieve reasonable prediction accuracy. Additionally, they suggest that more sophisticated predictors variables or predictive algorithms are needed to develop generalizable models capable of extracting robust insights into the root causes of early psychiatric readmissions.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Emergency department visits and boarding for pediatric patients with suicidality before and during the COVID-19 pandemic 93%
- The Benefits and Harms of Open Notes in Mental Health: A Delphi Survey of International Experts 92%
- Influences of race and clinical variables on psychiatric genetic research participation: Results from a schizophrenia sample 91%
Similar papers in this journal
- The path toward generalizable clinical prediction models 93%
- Receiving information on machine learning-based clinical decision support systems in psychiatric services increases staff trust in these systems: A randomized survey experiment 93%
- Stability of diagnostic coding of psychiatric outpatient visits across the transition from the second to the third version of the Danish National Patient Registry 92%
Similar papers in this journal
- Development and Evaluation of Machine Learning Models for the Detection of Emergency Department Patients with Opioid Misuse from Clinical Notes 93%
- Enhancing Research Data Infrastructure to Address the Opioid Epidemic: The Opioid Overdose Network (02-Net) 93%
- Characterization and Racial Stratification of Social Determinants of Health for Individuals with Type 2 Diabetes as Recorded in Electronic Health Records: Implications for Artificial Intelligence Development 91%
Similar papers in this journal
- Applications of Large Language Models in Psychiatry: A Systematic Review 93%
- Understanding Psychiatric Illness Through Natural Language Processing (UNDERPIN): Rationale, Design, and Methodology 92%
- Patients with affective disorders profit most from telemedical treatment: Evidence from a naturalistic patient cohort during the COVID-19 pandemic 92%
Similar papers in this journal
- Improving ascertainment of suicidal ideation and suicide attempt with natural language processing 93%
- Using explainable machine learning to identify patients at risk of reattendance at discharge from emergency departments 92%
- Scalable Incident Detection via Natural Language Processing and Probabilistic Language Models 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.