Back

Role-Prompting in Frontier Large Language Models Influences Clinical Reasoning in Complex Medical Cases

Dave, C.; Diviero, A.; Dassanayake, T.; Alshahrani, S. J.; Al Mardini, A.; Khadir, W.; Patel, A. D.; Srivastava, A.

2026-07-01 medical ethics
10.64898/2026.06.29.26356864 medRxiv
Show abstract

Background: Large language models (LLMs) are increasingly deployed in healthcare, where they may adopt different stakeholder perspectives, yet the effect of role-prompting on clinical ethical reasoning remains poorly characterized. Methods: We evaluated three frontier LLMs: Claude Opus 4.6, GPT-5.4, and Gemini 3.1 Pro across 25 ethically complex medical cases. Each model responded from three stakeholder perspectives (physician, patient, insurer) across three independent runs (675 total responses). Decisions were benchmarked against a six-physician panel. Ethical value prioritization was analyzed from physician- and LLM-provided ranked values. A Patient-Centric Decision Index (PCDI) was developed to quantify LLM decision alignment with patient-preferred out-comes. Results: Among 20 cases with clear physician consensus, LLMs prompted as an insurer reduced alignment with physician majority by 50% for GPT-5.4 (p = 0.004), 45% for Gemini 3.1 Pro (p = 0.008) and 10.5% (NS) for Opus 4.6. The insurer role shifted primary ethical values from beneficence (27%) to financial stewardship (20%) across all LLMs. Conclusions: Stakeholder role-prompting fundamentally alters clinical decisions and ethical value frameworks of frontier LLMs, with the insurer role producing systematic denial of physician-endorsed, patient-preferred treatments. These findings raise the need for standardized LLM patient-centricity benchmarks, and physician oversight when LLMs are deployed in clinical decision-making.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
npj Digital Medicine
118 papers in training set
Top 0.2%
22.8%
2
PLOS ONE
5266 papers in training set
Top 20%
9.3%
3
Social Science & Medicine
17 papers in training set
Top 0.1%
7.0%
4
DIGITAL HEALTH
17 papers in training set
Top 0.1%
7.0%
5
JAMA Network Open
130 papers in training set
Top 0.5%
5.7%
50% of probability mass above
6
PLOS Digital Health
106 papers in training set
Top 1%
4.5%
7
BMC Medicine
176 papers in training set
Top 0.7%
4.2%
8
Journal of the American Medical Informatics Association
71 papers in training set
Top 0.9%
3.4%
9
Value in Health
11 papers in training set
Top 0.1%
3.4%
10
Royal Society Open Science
214 papers in training set
Top 2%
2.7%
11
BMJ Health & Care Informatics
15 papers in training set
Top 0.4%
2.5%
12
Communications Medicine
113 papers in training set
Top 2%
1.8%
13
BMJ Open
601 papers in training set
Top 9%
1.8%
14
JMIR Medical Informatics
18 papers in training set
Top 0.5%
1.6%
15
JMIR Formative Research
33 papers in training set
Top 0.9%
1.4%
16
eBioMedicine
183 papers in training set
Top 4%
1.2%
17
British Journal of Clinical Pharmacology
21 papers in training set
Top 0.3%
1.2%
18
Acta Psychiatrica Scandinavica
10 papers in training set
Top 0.1%
1.1%
19
Healthcare
17 papers in training set
Top 0.7%
1.1%
20
BMC Health Services Research
51 papers in training set
Top 2%
1.0%
21
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 39%
1.0%
22
The Lancet Digital Health
25 papers in training set
Top 1.0%
0.5%
23
Scientific Reports
3612 papers in training set
Top 81%
0.5%