Improving Doctor-Patient Communication Using Large Language Models - Results from an Experimental Study
Böffel, C.; Soyka, S. J.; Mundi, S.; Wick, W.; Schlittmeier, S. J.; Venkataramani, V.
Show abstract
ImportanceMedical jargon poses significant barriers to patient comprehension of healthcare information, potentially affecting treatment adherence and health outcomes. ObjectiveTo investigate whether large language models (LLMs) can improve patient understanding of medical notes by translating complex medical terminology into comprehensible lay language. Design, Setting, and ParticipantsThis experimental online study was conducted between August 27 and October 8 2024 using a within-subjects design. Participants were recruited from a university population and included 63 adults aged 19-30 years (52 female [82.5%]; mean age 21.9 years), who completed the full study protocol. InterventionsFour fictional medical notes representing typical neurological cases (stroke, neuromyelitis optica, meningitis, subarachnoid hemorrhage) were created by neurologists and translated into lay language using GPT-4. Each participant viewed two original and two translated notes in counterbalanced order. Main Outcomes and MeasuresPrimary outcomes included objective comprehension measured through content-related questions, self-paced reading times and subjective ratings of understanding, difficulty, empathy, and mental effort on 5-point Likert scales. ResultsThe translated notes demonstrated significant improvements across all measured dimensions, except for average reading times. Participants achieved higher comprehension scores (effect size details to be added), reported greater subjective understanding, perceived higher empathy, and experienced reduced mental effort and negative emotions when reading translated versus original medical notes. Conclusions and RelevanceLLM translation of medical notes significantly improved both objective and subjective patient understanding. From a psychological perspective, these results align with predictions from cognitive load theory, emphasising the importance of adapting language complexity to reduce processing demands in communication between laypeople and experts. These findings suggest potential for integrating AI-assisted communication tools in clinical practice to enhance patient comprehension and engagement, though implementation considerations including accuracy validation and clinician workflow integration require further investigation.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Evaluation of Large Language Models in Medical Examinations:A Scoping Review Protocol 94%
- Prohibiting Babel - A call for professional remote interpreting services in pre-operation anaesthesia information 94%
- Protocol For Human Evaluation of Artificial Intelligence Chatbots in Clinical Consultations 93%
Similar papers in this journal
Similar papers in this journal
- Physician experiences of electronic health records interoperability and its practical impact on care delivery in the English NHS: A cross-sectional survey study 93%
- What is the suitability of clinical vignettes in benchmarking the performance of online symptom checkers? An audit study 92%
- Evaluating a first fully automated interview grounded in Multiple Mini Interview (MMI) methodology: results from a feasibility study 92%
Similar papers in this journal
- Measures of socioeconomic advantage are not independent predictors of support for healthcare AI: subgroup analysis of a national Australian survey 93%
- AI-Generated Clinical Summaries: Errors and Susceptibility to Speech and Speaker Variability 93%
- Connecting Artificial Intelligence and Primary Care Challenges: Findings from a Multi-Stakeholder Collaborative Consultation 93%
Similar papers in this journal
- Generative artificial intelligence models in clinical infectious disease consultations: a cross-sectional analysis among specialists and resident trainees 94%
- Novel prefrontal synthesis intervention improves language in children with autism 88%
- A Protocol for Identifying Priorities for Women+ Health in the Maritime Provinces using a Priority Setting Partnership Approach 87%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.