Democratizing Virtual Patient Case Creation: A Proof-of-concept Technical Framework for Clinicians
Tsaftaridis, N.; Koulas, I.; Zafeiropoulos, S.; Saint-Joy, V.; Ilali, M.; Ibrahim, M.; Brice, T.; Haynes, N. A.
Show abstract
ObjectiveVirtual patient cases are a scalable and engaging tool for training medical professionals. Strategies and frameworks for their implementation in teaching and training settings are few, technically complicated and/or expensive. We developed and evaluated open source and free virtual patient cases to test knowledge acquisition during an echocardiography training program for internal medicine trainees in Haiti. The objective of this paper is to describe the technical aspects of the GMENEcho virtual patient cases implementation and motivate similar work by resource-constrained teams. MethodsWe used an open source engine for text-based games (Twine) since it provides the necessary interaction mechanics and is usable out-of-the-box. The case code was written in SugarCube 2.30.0 notation and the tweego-generated .html file was hosted on Github Pages for continuous integration and deployment, making iterations by the clinical team seamless. Data from completed tests were reported back via email through a third party integration. ResultsThe technical work was completed in two weeks by a team member with a clinical background and minimal computer programming experience. The virtual patient cases were deployed for a pretest (November 2023) and a second time unaltered for a posttest (June 2024) after the interim hands-on and theoretical training had been completed. Qualitative feedback was positive or neutral. The overall score in the posttest was significantly higher with a large effect size (mean absolute improvement 15.26%, p < 0.001; Cohens d: 1.398), similarly to the diagnostic score (mean absolute difference 16.09%, p < 0.001; Cohens d: 1.402). Management performance missed statistical significance by a small margin. The System Usability Scale (SUS) score was 74.6 ("Excellent").There was reduced inter-trainee variability across metrics in the posttest, including the SUS score. DiscussionThis proof-of-concept methodology can be applied to create clinical patient cases for use within a class or a clinical training setting, through a friendly graphical user interface. A more complex software stack can allow for remote or larger scale implementations with additional features. ConclusionThe rapid development time and positive qualitative and quantitative feedback highlight the potential of this approach for clinical education in resource-constrained settings. It can serve as a template for more streamlined adaptations of case-based learning in diverse healthcare settings.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Medical Clinical Minds Meet Artificial Intelligence: Italian Physicians' Knowledge, Attitudes, and Concordance between Italian Physicians and AI-Generated Diagnoses. A National Cross-Sectional Study 93%
- Implementing Home-Based Digital Health in Rural Canada: A Scoping Review 91%
- Development and Validation of a Machine Learning Model Integrated with the Clinical Workflow for Inpatient Discharge Date Prediction 91%
Similar papers in this journal
- Theory of radiologist interaction with instant messaging decision support tools: a sequential-explanatory study 95%
- Cardiology Knowledge Assessment of Retrieval-Augmented Open versus Proprietary Large Language Models 94%
- Harnessing the Open Access Version of ChatGPT for Enhanced Clinical Opinions 93%
Similar papers in this journal
- Large language models for generating medical examinations: systematic review 95%
- Improving capacity for advanced training in obstetric surgery: Evaluation of a blended learning approach 93%
- Team-Based Learning Versus Lecture-Based Instruction for Chest Radiograph Interpretation in Physician Associate Education: A Quasi-Experimental Study 93%
Similar papers in this journal
- Improving emergency department patient-doctor conversation through an artificial intelligence symptom taking tool: an action-oriented design pilot study 94%
- The potential for digital patient symptom recording through symptom assessment applications to optimize patient flow and reduce waiting times in Urgent Care Centers: a simulation study 93%
- Is virtual care the new normal? Evidence supporting Covid-19’s durable transformation on healthcare delivery 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.