Identify Patients at Risk of HIV Using a Clinical Large Language Model from Electronic Health Records
Liu, Y.; Chen, Z.; Suman, P.; Cho, H.; Prosperi, M.; Wu, Y.
Show abstract
This study developed a large language model (LLM)-based solution to identify people at HIV risk using electronic health records. We transformed structured EHR data, including demographics, diagnoses, and medications, into narrative descriptions ordered by visit date and applied GatorTron, a widely used clinical LLM trained on 82 billion words of de-identified clinical text. We compared GatorTron with traditional machine learning models, including LASSO and XGBoost. We identified a cohort with 54,265 individuals, where only 3,342 (6%) had new HIV diagnoses. Our LLM solution, based on GatorTron, achieved excellent performance, reaching an F1 score of 53.5% and an AUC of 0.88, comparable to traditional machine learning approaches. Subgroup analysis showed that, across age, sex, and race/ethnicity groups, both LLM and traditional models achieved AUCs above 0.82. Interpretability analyses showed broadly consistent patterns across LLM models and traditional machine learning models.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A Deep Learning Method to Detect Opioid Prescription and Opioid Use Disorder from Electronic Health Records 95%
- Emergence and Evolution of Big Data Analytics in HIV Research: Bibliometric Analysis of Federally Sponsored Studies 2000-2019 93%
- Development and Evaluation of MADDIE: Method to Acquire Delivery Date Information from Electronic Health Records 91%
Similar papers in this journal
- A Decision Analytics Model to Optimize Investment in Interventions Targeting the PrEP Cascade of Care 92%
- Use of undetectable viral load to improve survey estimates of known HIV-positive status and antiretroviral treatment coverage 91%
- National HIV testing and diagnosis coverage in sub-Saharan Africa: a new modeling tool for estimating the \"first 90\" from program and survey data 91%
Similar papers in this journal
- Demographic and socioeconomic determinants of access to care: A subgroup disparity analysis using new equity-focused measurements 93%
- The Risks and Benefits of Providing HIV Services during the COVID-19 Pandemic 93%
- Joint modeling HIV and HPV using a new hybrid agent-based network and compartmental simulation technique 92%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.