Impact of an ambient digital scribe on typing and note quality: the AutoscriberValidate study
Bauer, M. P.; van Tol, E. M.; Constansia, T. K. M.; King, L.; van Buchem, M. M.
Show abstract
BackgroundTyping in the electronic health record (EHR) takes up healthcare providers time and cognitive space and constitutes a substantial administrative burden contributing to high burnout rates in healthcare. Ambient digital scribes may improve this problem. ObjectiveTo investigate the effect of the use of Autoscriber, an ambient digital scribe, on healthcare providers administrative workload and the quality of medical notes in the EHR. MethodsA study period of 26 weeks was randomized into weeks when healthcare providers were allowed to use Autoscriber (intervention weeks) and weeks when they were not (control weeks) in a 2:1 ratio. Workload was assessed by comparing the number of characters typed in the medical note during control weeks with the number of modifications that were made to the summary produced by Autoscriber during intervention weeks. Quality of the medical note was measured by having a large language model (LLM) count the number of hallucinations, incorrect negations, context conflation errors, speculations, other inaccuracies, omissions, succinctness errors, organization errors and terminology errors per medical note. ResultsBetween 1 November 2024 and 30 April 2025, 35 healthcare providers from 14 different specialties recorded 387 consultations in intervention weeks, and 142 in control weeks. The median number of characters typed per medical note was 1079 in control weeks and the median number of modifications necessary to produce the medical note was 351 in intervention weeks, compatible with a lower workload. All types of errors occurred significantly less frequently in notes made with the support of Autoscriber than in those without, except for speculations, where the difference did not reach statistical significance. ConclusionsThe use of Autoscriber resulted in a lower workload and a higher quality of the medical note.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Improving emergency department patient-doctor conversation through an artificial intelligence symptom taking tool: an action-oriented design pilot study 95%
- Exploring Patient and Staff Experiences of Video Consultations During COVID-19 in an English Outpatient Care Setting: Secondary Data Analysis of Routinely Collected Feedback Data 94%
- A Web-based, Mobile Responsive Application to Screen Healthcare Workers for COVID Symptoms: Descriptive Study 93%
Similar papers in this journal
- Understanding how the design and implementation of Online Consultations influence primary care outcomes: Systematic review of evidence with recommendations for designers, providers, and researchers 94%
- Structured Codes and Free-Text Notes: Measuring Information Complementarity in Electronic Health Records 94%
- Design and implementation of a system for automated monitoring of adherence to evidenced-based clinical guideline recommendations 94%
Similar papers in this journal
- AI-Generated Clinical Summaries: Errors and Susceptibility to Speech and Speaker Variability 94%
- User Testing of a Diagnostic Decision Support System with Machine-assisted Chart Review to Facilitate Clinical Genomic Diagnosis 94%
- Development of a customised data management system for a COVID-19-adapted colorectal cancer pathway 94%
Similar papers in this journal
- Clinical code sets and the problem of redundancy in code set repositories 95%
- Protocol For Human Evaluation of Artificial Intelligence Chatbots in Clinical Consultations 94%
- Identifying clinical skill gaps of healthcare workers using a digital clinical decision support algorithm during outpatient pediatric consultations in primary health centers in Rwanda 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.