Improving risk assessment in forensic mental health: temporal validation and clinical refinement of the FoVOx risk tool
Sivak, L.; Forsman, J.; Sariaslan, A.; Tiihonen, J.; Fazel, S.
Show abstract
BackgroundForensic psychiatric services are expanding in many countries, and discharging patients from secure hospitals relies on accurate estimates of risk of adverse outcomes. Novel evidence-based tools for estimating one key risk, violent reoffending, have been developed in recent years. We aimed to externally validate one new tool, FoVOx, in forensic psychiatric patients sentenced to treatment, and to develop an updated model (FoVOx2), incorporating additional clinical predictors. MethodsUsing Swedish national registers, we conducted a temporal external validation of FoVOx by examining 767 patients discharged between 2014 and 2023. For the FoVOx2 cohort, 906 patients discharged between 2008 and 2023 were followed up, and additional predictors tested. The outcome was violent reconviction within 12 or 24 months. Model performance was evaluated using Harrells C-index, time-dependent AUCs, calibration, and classification metrics at predefined thresholds. ResultsIn temporal validation, FoVOx showed moderate discrimination (AUCs 0.69 and 0.71; C-index = 0.69) and acceptable overall accuracy (Brier <0.11). Calibration was generally good, with mild overestimation at the highest predicted risks (>20%) at 12 months and slight underprediction at 24 months. The updated FoVOx2 model newly incorporated clozapine treatment and additional diagnostic categories. It was associated with improved performance (AUCs 0.77; optimism-corrected C-index = 0.72; Brier 0.06 and 0.09) and achieved good calibration (intercept {approx} 0; slopes 1.03 and 1.05). ConclusionsUpdating risk assessment tools with additional clinical factors can lead to incremental improvement in model performance. Implementing tools should consider clinical utility and impact as next steps.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Short-term functional outcome in psychotic patients. Results of the Turku Early Psychosis Study (TEPS) 93%
- Current state of the evidence on community treatments for people with complex emotional needs: a scoping review 93%
- Treatment Resistant Depression in electronic health records: Definitions Matter 92%
Similar papers in this journal
- Predictors of suicidal thoughts and behavior in children: results from penalized logistic regression analyses in the ABCD study 95%
- Analysis of diagnosis instability in electronic health records reveals diverse disease trajectories of severe mental illness 94%
- Associations between antipsychotic use, substance use and relapse risks in patients with schizophrenia - real-world evidence from two national cohorts 93%
Similar papers in this journal
- Studying the context of psychoses to improve outcomes in Ethiopia (SCOPE): protocol paper 93%
- One year prevalence of psychotic disorders among first treatment contact patients at the National Psychiatric referral and teaching hospital in Uganda 93%
- Emergency department visits and boarding for pediatric patients with suicidality before and during the COVID-19 pandemic 92%
Similar papers in this journal
- Clinical benefits of modifying the evening light environment in an acute psychiatric unit: A single-centre, two-arm, parallel-group, pragmatic effectiveness randomised controlled trial 93%
- Identifying Potential Causal Risk Factors for Self-Harm: A Polygenic Risk Scoring and Mendelian Randomisation Approach 93%
- Risk of common psychiatric disorders, suicidal behaviours and premature mortality following violent victimisation: A matched cohort and sibling-comparison study of 127,628 people who experienced violence in Finland and Sweden 92%
Similar papers in this journal
- Risk factors for suicide following treatment with electroconvulsive therapy: A nationwide study of 11,780 patients 95%
- Stability of diagnostic coding of psychiatric outpatient visits across the transition from the second to the third version of the Danish National Patient Registry 94%
- Deterioration of patients with mental disorders in Denmark coinciding with the invasion of Ukraine 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.