Textual Triage: Assessing GPT4 for Classification of Free-Text Medication-Related Messages for Hypertension Management
Batugo, A.; Hwang, S.; Davoudi, A.; Luong, T.; Lee, N.; Mowery, D.
Show abstract
Patient-generated free-text messages are a well-recognized source of clinical burden and burnout for clinicians. Machine learning approaches such as Large Language Models (LLMs) may be applied to alleviate this burden by automatically triaging and classifying messages, but their performance in this domain has not been fully characterized. In this study, we analyzed the effectiveness of GPT4 for classifying patient and provider messages for hypertension management through prompt engineering, comparing its performance to an alternative unsupervised generative statistical approach. The results of this study suggest GPT is promising for classification of medical-related messages even with very few guiding examples.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Listening to mental health crisis needs at scale: using Natural Language Processing to understand and evaluate a mental health crisis text messaging service 93%
- Large Language Models in Real-World Clinical Workflows: A Systematic Review of Applications and Implementation 93%
- Development and Validation of a Machine Learning Model Integrated with the Clinical Workflow for Inpatient Discharge Date Prediction 92%
Similar papers in this journal
- Natural Language Processing for Automated Annotation of Medication Mentions in Primary Care Visit Conversations 95%
- A Study of Calibration as a Measurement of Trustworthiness of Large Language Models in Biomedical Research 94%
- Comparative Effectiveness of Medical Concept Embedding for Feature Engineering in Phenotyping 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.