Large language models outperform traditional structured data-based approaches in identifying immunosuppressed patients
Guggilla, V.; Kang, M.; Bak, M. J.; Tran, S. D.; Pawlowski, A.; Nannapaneni, P.; Rasmussen, L. V.; Schneider, D.; Donnelly, H. K.; Agrawal, A.; Liebovitz, D.; Misharin, A. V.; Budinger, G. S.; Wunderink, R. G.; Walunas, T. L.; Gao, C. A.; The NU SCRIPT Study Investigators,
Show abstract
Identifying immunosuppressed patients using structured data can be challenging. Large language models effectively extract structured concepts from unstructured clinical text. Here we show that GPT-4o outperforms traditional approaches in identifying immunosuppressive conditions and medication use by processing hospital admission notes. We also demonstrate the extensibility of our approach in an external dataset. Cost-effective models like GPT-4o mini and Llama 3.1 also perform well, but not as well as GPT-4o.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Clinical Knowledge Extraction via Sparse Embedding Regression (KESER) with Multi-Center Large Scale Electronic Health Record Data 94%
- Finding Long-COVID: Temporal Topic Modeling of Electronic Health Records from the N3C and RECOVER Programs 92%
- Machine Learning for Real-Time Aggregated Prediction of Hospital Admission for Emergency Patients 92%
Similar papers in this journal
Similar papers in this journal
- Transformer-based deep learning model for the diagnosis of suspected lung cancer in primary care based on electronic health record data 93%
- Consistent Performance of GPT-4o in Rare Disease Diagnosis Across Nine Languages and 4967 Cases 91%
- Machine learning guided association of adverse drug reactions with in vitro target-based pharmacology 90%
Similar papers in this journal
Similar papers in this journal
- Evaluation of Domain Generalization and Adaptation on Improving Model Robustness to Temporal Dataset Shift in Clinical Medicine 93%
- Machine learning approach to dynamic risk modeling of mortality in COVID-19: a UK Biobank study 93%
- Large Language Models Improve the Identification of Emergency Department Visits for Symptomatic Kidney Stones 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.