Back

Utility of GPT-4 as an Informational Patient Resource in Otolaryngology

Suresh, K.; Rathi, V. K.; Nwosu, O.; Partain, M. P.; Glicksman, J. T.; Jowett, N.; Crowson, M. G.

2023-05-16 otolaryngology
10.1101/2023.05.14.23289944 medRxiv
Show abstract

We sought to understand the potential utility of ChatGPT as an informational resource for otolaryngology patients. We evaluated responses by GPT-4 to queries based on the American Academy of Otolaryngologys Clinical Practice Guidelines. We found that while otolaryngology advice provided by ChatGPT is generally safe, it lacks accuracy and comprehensiveness, limiting its utility as an informational resource for patients. Lay SummaryAs the popularity of ChatGPT explodes, patients may turn to it for medical advice. We found that while otolaryngology advice provided by ChatGPT is generally safe, it lacks accuracy and comprehensiveness, limiting its utility as an informational resource for patients.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.