Back

Clinical Safety of AI-Generated Antibiotic Prescribing Advice: Guideline Adherence and Misinformation Risk Among Large Language Models

Khan, M. M.; Anwar, M. N.

2026-05-15 public and global health
10.64898/2026.05.13.26352828 medRxiv
Show abstract

Background: Large language models (LLMs) are increasingly used in telehealth, but their safety in antibiotic prescribing remains uncertain, particularly in the presence of patient misinformation. Methods: A cross-sectional analytical study evaluated 5,000 responses from five chatbot models using 1,000 primary-care vignettes of mild infections. Guideline adherence, overprescribing, misinformation effects, and safety behaviors were assessed. Inappropriate prescriptions were classified using the WHO AWaRe framework. Results: Overall, 76.2% of responses were guideline-concordant, while 6.6% showed unprompted overprescribing and 17.2% were influenced by misinformation. Some models were more vulnerable to misinformation than others. Although most responses correctly noted that antibiotics do not treat viral infections, fewer advised consulting a doctor, and warnings against self-medication were rare. Many inappropriate prescriptions involved broad-spectrum antibiotics. Conclusion: LLMs show potential in telehealth but remain prone to misinformation and inappropriate prescribing. Stronger guideline integration and clinical oversight are necessary to ensure safe use. Keywords: antimicrobial stewardship; large language models; telehealth; antibiotic prescribing; misinformation; clinical safety

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
Journal of Medical Internet Research
85 papers in training set
Top 0.1%
26.4%
2
npj Digital Medicine
97 papers in training set
Top 0.5%
10.6%
3
PLOS ONE
4510 papers in training set
Top 17%
10.3%
4
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.6%
4.7%
50% of probability mass above
5
Frontiers in Public Health
140 papers in training set
Top 2%
4.0%
6
PLOS Digital Health
91 papers in training set
Top 0.7%
3.7%
7
JMIR Formative Research
32 papers in training set
Top 0.3%
3.7%
8
BMC Infectious Diseases
118 papers in training set
Top 1%
2.8%
9
Pharmacoepidemiology and Drug Safety
13 papers in training set
Top 0.1%
2.4%
10
JMIR Public Health and Surveillance
45 papers in training set
Top 1%
2.1%
11
JMIRx Med
31 papers in training set
Top 0.4%
2.1%
12
Journal of General Internal Medicine
20 papers in training set
Top 0.3%
2.1%
13
F1000Research
79 papers in training set
Top 2%
1.4%
14
Scientific Reports
3102 papers in training set
Top 65%
1.2%
15
Frontiers in Digital Health
20 papers in training set
Top 0.9%
1.2%
16
BMC Medical Informatics and Decision Making
39 papers in training set
Top 2%
1.1%
17
International Journal of Medical Informatics
25 papers in training set
Top 1%
1.0%
18
BMJ Open
554 papers in training set
Top 11%
0.9%
19
Clinical Infectious Diseases
231 papers in training set
Top 4%
0.9%
20
Pilot and Feasibility Studies
12 papers in training set
Top 0.5%
0.8%
21
Cancer Medicine
24 papers in training set
Top 1%
0.7%
22
Healthcare
16 papers in training set
Top 2%
0.7%
23
JMIR Medical Informatics
17 papers in training set
Top 2%
0.7%
24
Journal of Biomedical Informatics
45 papers in training set
Top 2%
0.5%
25
JAMA Network Open
127 papers in training set
Top 5%
0.5%