OpenPFx: Evaluating the Ability of LLMs to Create Patient-Friendly Explanations of Radiological Incidental Findings
Hentel, J. Z.; teichman, k. t.; Shih, G.
Show abstract
The 21st Century Cures Act mandates patient access to electronic health information, yet radiology reports often remain inaccessible due to specialized terminology and widespread low health literacy. This study evaluates large language model (LLM)-based workflows for generating patient-friendly explanations (PFx) of incidental MRI findings. Four approaches--zero-shot, few-shot, multiple few-shot, and agentic--were benchmarked using ICD-10 code alignment for accuracy and Flesch Reading Ease scores for readability. Across 407 outputs per workflow, the agentic method demonstrated the strongest overall performance, achieving a sixth-grade reading level and the highest accuracy. Compared with prior work limited by small sample sizes or suboptimal readability, these results indicate that structured, agent-based LLM workflows can improve both clarity and diagnostic consistency at scale. By translating complex radiology findings into accessible language, AI-generated PFx provide a scalable strategy to reduce health literacy disparities and advance the Cures Acts goal of making medical data both transparent and usable for patients.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Harnessing the Open Access Version of ChatGPT for Enhanced Clinical Opinions 95%
- Theory of radiologist interaction with instant messaging decision support tools: a sequential-explanatory study 95%
- Implementation and prospective real-time evaluation of a generalized system for in-clinic deployment and validation of machine learning models in radiology 94%
Similar papers in this journal
Similar papers in this journal
- Connecting Artificial Intelligence and Primary Care Challenges: Findings from a Multi-Stakeholder Collaborative Consultation 94%
- User Testing of a Diagnostic Decision Support System with Machine-assisted Chart Review to Facilitate Clinical Genomic Diagnosis 93%
- Development of a customised data management system for a COVID-19-adapted colorectal cancer pathway 93%
Similar papers in this journal
- Signal from the Noise: A Mixed Methods Process Mining Approach to Evaluate Care Pathways. 94%
- EHR-QC: A streamlined pipeline for automated electronic health records standardisation and preprocessing to predict clinical outcomes 94%
- Detecting Goals of Care Conversations in Clinical Notes with Active Learning 93%
Similar papers in this journal
- Evaluating Semantic Similarity Methods for Comparison of Text-derived Phenotype Profiles 93%
- Temporal Relationship of Computed and Structured Diagnoses in Electronic Health Record Data 92%
- Development and Validation of ‘Patient Optimizer’ (POP) Algorithms for Predicting Surgical Risk with Machine Learning 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.