Life Events Extraction From Healthcare Notes for Veteran Acute Suicide Prediction
Morrow, D.; Zamora-Resendiz, R.; Beckham, J. C.; Kimbrel, N. A.; McMahon, B. H.; Crivelli, S.
Show abstract
Background/AimsPredictive models of suicide risk have focused on predictors extracted from structured data found in electronic health records (EHR), with limited consideration of predisposing life events (LE) expressed in unstructured clinical text such as housing instability and marital troubles. Additionally, there has been limited work in large-scale analysis of natural language processing (NLP) derived predictors for suicide risk and integration of extracted LE into longitudinal models of suicide risk. This study aims to expand upon previous research, demonstrating how high-performance computing (HPC) and machine learning technologies such as language models (LM) can be used to annotate and integrate 8 LE across all Veterans Health Administration (VHA) unstructured clinical text data with enriched performance metrics. Materials/MethodsVHA-wide clinical text from January 2000 to January 2022 were pre-processed and analyzed using HPC. Data-driven lexicon curation was performed for each LE by scaling a nearest-neighbor search over a precomputed index with LM embeddings. Data parallelism was applied to a rule-based annotator to extract LE, followed by random forest for improved positive predictive value (PPV). NLP results were analyzed and then integrated and compared to a baseline statistical model predicting risk for a combined outcome (suicide death, suicide attempt and overdose). ResultsFirst-time LE mentions, with a PPV of 0.8 or higher, showed a temporal correlation to suicide-related events (SRE) (suicide ideation, attempt and/or death). A significant increase of LE occurrences was observed starting 2.5 months prior to an SRE. Predictive models integrating NLP-derived LE show an improved AUC of 0.81 vs. a 0.79 obtained with the baseline and novel patient identification of up to 57%. DiscussionOur analysis shows that: 1) performance metrics, specifically PPV, improved significantly from previous work and outperform related works; 2) the mentions of LE in the unstructured data increase as time to a SRE approaches; 3) LE identified from the notes in the weeks prior to a SRE were not associated with administrative bias caused by outreach; and 4) LE improved the AUC of predictive models and identified novel patients at risk for suicide. ConclusionThe resulting person-period longitudinal data demonstrated that NLP-derived LE served as acute predictors for suicide-related events. NLP integration into predictive models may help improve clinician decision support. Future work is necessary to better define these LE.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions 95%
- A Deep Learning Approach for Transgender and Gender Diverse Patient Identification in Electronic Health Records 94%
- ConceptWAS: a high-throughput method for early identification of COVID-19 presenting symptoms 93%
Similar papers in this journal
Similar papers in this journal
- Development and Evaluation of Machine Learning Models for the Detection of Emergency Department Patients with Opioid Misuse from Clinical Notes 94%
- Enhancing Research Data Infrastructure to Address the Opioid Epidemic: The Opioid Overdose Network (02-Net) 94%
- Natural Language Processing for Automated Annotation of Medication Mentions in Primary Care Visit Conversations 93%
Similar papers in this journal
- A Deep Learning Method to Detect Opioid Prescription and Opioid Use Disorder from Electronic Health Records 94%
- Assessment of machine learning algorithms in national data to classify the risk of self-harm among young adults in hospital: a retrospective study 92%
- Synthetic Data Generation in Healthcare: A Scoping Review of reviews on domains, motivations, and future applications 91%
Similar papers in this journal
- Building Large-Scale Registries from Unstructured Clinical Notes using a Low-Resource Natural Language Processing Pipeline 94%
- The role of natural language processing in cancer care: a systematic scoping review with narrative synthesis 93%
- Deep ensemble multitask classification of emergency medical call incidents combining multimodal data improves emergency medical dispatch 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.