Reconsidering the case against risk prediction in self-harm: routinely collected health data distinguishes groups at higher and lower risk of adverse outcomes following paracetamol overdose
Oxley, J.; Schölin, L.; Brennan, G.; Anand, A.; Brett, J.; Eddleston, M.; Humphries, C.
Show abstract
Background. UK clinical guidance recommends that structured risk prediction tools and risk stratification should not be used in self-harm, to predict suicide or determine who is offered treatment. Underpinning this position is the premise that routinely collected health data contain no useful predictive signal, which has received little direct scrutiny. Objective. To test whether routinely collected electronic health record data can distinguish groups at higher and lower risk of severe outcomes following paracetamol overdose. Methods. We analysed 4,095 adults presenting to NHS Lothian emergency departments with paracetamol overdose (2017-2023). Elastic-net logistic regression was fitted to 37 routinely collected electronic health record features to predict a composite of death or mental health inpatient admission at 0-7, 8-30 and 31-365 days following attendance, evaluated on a held-out 20% test set with bootstrapping. Findings. Events occurred in 5.5% of patients at 0-7 days, 2.0% at 8-30 days and 7.9% at 31-365 days, dominated by mental health admission. Bootstrap AUROC 95% confidence intervals lay above 0.5 in every window (0.65-0.82, 0.63-0.90, 0.71-0.85): models ranked patients better than chance. Calibration slopes (1.04, 1.14, 1.07) were close to one. Ranking drew primarily on mental health-related features. Conclusions. Routinely collected health data carried predictive signal for severe outcomes after paracetamol overdose, although discrimination fell short of what is needed for individual-level clinical use. Clinical implications. These models are not proposed for clinical deployment; however, treating risk prediction as a settled question will redirect research efforts, potentially excluding this patient population from machine learning advances driving improvements in care in other medical specialties.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Ethnic inequalities in compulsory psychiatric hospital detentions during UK COVID-19 'lockdowns': A Regression Discontinuity Design in time study 93%
- Associations between antipsychotic use, substance use and relapse risks in patients with schizophrenia - real-world evidence from two national cohorts 92%
- Latent subtypes of manic or irritable episode symptoms in two population-based cohorts 92%
Similar papers in this journal
- Predicting involuntary admission following inpatient psychiatric treatment using machine learning trained on electronic health record data 96%
- Longitudinal impact of different treatment sequences of second-generation antipsychotics on metabolic outcomes: a study using targeted maximum likelihood estimation 92%
- Antipsychotic Polypharmacy and Adverse Drug Reactions Among Adults in a London Mental Health Service, 2008-2018 92%
Similar papers in this journal
- Living alone and mental health: parallel analyses in longitudinal population surveys and electronic health records prior to and during the COVID-19 pandemic 93%
- The impact of the COVID-19 pandemic on Antidepressant Prescribing with a focus on people with learning disability and autism: An interrupted time-series analysis in England using OpenSAFELY-TPP 92%
- Co-prescription of Metformin and Antipsychotics in Severe Mental Illness: A UK Primary Care Cohort Study 92%
Similar papers in this journal
- The path toward generalizable clinical prediction models 94%
- Stability of diagnostic coding of psychiatric outpatient visits across the transition from the second to the third version of the Danish National Patient Registry 92%
- Receiving information on machine learning-based clinical decision support systems in psychiatric services increases staff trust in these systems: A randomized survey experiment 92%
Similar papers in this journal
- Psychiatric disorders and self-harm across 26 adult cancers: cumulative burden, temporal variation, excess years of life lost and unnatural causes of deaths 92%
- Polygenic risk scores lack prognostic value for adults with severe mental illness 91%
- Risk factors for intensive care admission and death amongst children and young people admitted to hospital with COVID-19 and PIMS-TS in England during the first pandemic year 90%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.