Back

Prompt Engineering GPT-4 to Answer Patient Inquiries: A Real-Time Implementation in the Electronic Health Record across Provider Clinics

Afshar, M.; Gao, Y.; Wills, G.; Wang, J.; Churpek, M. M.; Westenberger, C. J.; Kunstman, D. T.; Gordon, J. E.; Liao, F. J.; Patterson, B. W.

2024-01-24 health informatics
10.1101/2024.01.23.24301692 medRxiv
Show abstract

Withdrawal StatementThe authors have withdrawn their manuscript owing to needing additional internal review. Therefore, the authors do not wish this work to be cited as a reference for the project. If you have any questions, please contact the corresponding author.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
Journal of the American Medical Informatics Association
◐ 71 papers in training set
Top 0.1%
38.5%
Similar papers in this journal
2
Journal of Medical Internet Research
◐ 87 papers in training set
Top 0.2%
9.4%
Similar papers in this journal
3
JAMIA Open
◐ 42 papers in training set
Top 0.2%
7.7%
Similar papers in this journal
50% of probability mass above
4
JMIR Medical Informatics
◐ 18 papers in training set
Top 0.1%
6.6%
Similar papers in this journal
5
DIGITAL HEALTH
○ 17 papers in training set
Top 0.1%
4.2%
Similar papers in this journal
6
PLOS Digital Health
● 106 papers in training set
Top 2%
3.9%
7
npj Digital Medicine
○ 118 papers in training set
Top 1%
3.9%
8
International Journal of Medical Informatics
○ 26 papers in training set
Top 0.2%
3.9%
9
JMIR Formative Research
◐ 33 papers in training set
Top 0.5%
3.1%
10
Frontiers in Digital Health
○ 24 papers in training set
Top 0.3%
2.7%
11
BMC Medical Informatics and Decision Making
○ 43 papers in training set
Top 0.9%
2.1%
12
Journal of Biomedical Informatics
○ 47 papers in training set
Top 0.7%
2.1%
13
BMJ Health & Care Informatics
● 15 papers in training set
Top 0.6%
1.9%
14
PLOS ONE
● 5266 papers in training set
Top 47%
1.7%
15
BMJ Open
● 601 papers in training set
Top 12%
1.0%
16
JMIR Research Protocols
◐ 21 papers in training set
Top 1%
0.8%
17
GigaScience
◐ 212 papers in training set
Top 5%
0.6%

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.