What Do Clinicians Edit in Ambient AI-Drafted Clinical Documentation? A Qualitative Content Analysis
Guo, Y.; Hu, D.; Yang, Z.; Kim, S.; Tran, B.; Lee, J.; Vallabhaneni, S.; Zehrung, R.; Sutari, S.; Tam, S.; Chow, E.; Perret, D.; Pandita, D.; Zheng, K.
Show abstract
ObjectiveAmbient artificial intelligence (AI) documentation is increasingly used to draft clinical notes from patient-provider conversations, but how clinicians revise and finalize these drafts is not well understood. This qualitative content analysis study characterizes real-world edits to AI-generated drafts and identifies opportunities for improvement of AI design and the implementation process. Materials and MethodsEight coders analyzed clinical documentation generated by ambient AI from 200 clinical encounters. We developed an inductive coding framework with 11 codes across three categories: clinical content, terminology, and language style. Interrater reliability was assessed using Cohens kappa. We then applied thematic analysis to synthesize patterns across the coded edits. ResultsThe most frequently edited content pertained to clinical facts including orders (e.g., procedures, lab tests) (40.0%), symptoms (30.3%), medication prescriptions (27.3%), and diagnosis descriptions (25.9%). In comparison, edits related to terminology use (11.6%) and language style (7.2%) were less frequent. The results of our thematic analysis show that most edits can be categorized into one of the following five types: to correct factual errors, to address needs of medical specialty, to express diagnostic certainties, to convert patient expressions into objective assessments recorded in medical terms, and to reorganize or condense content. Conclusion and DiscussionClinicians routinely revise ambient AI drafts to improve accuracy and clinical specificity. Future work on AI development and clinical implementation should emphasize specialty customization and support personalized documentation practices, alongside clinician education that promotes robust and consistent review routines to ensure documentation quality.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- User Testing of a Diagnostic Decision Support System with Machine-assisted Chart Review to Facilitate Clinical Genomic Diagnosis 95%
- Connecting Artificial Intelligence and Primary Care Challenges: Findings from a Multi-Stakeholder Collaborative Consultation 93%
- Development of a customised data management system for a COVID-19-adapted colorectal cancer pathway 92%
Similar papers in this journal
- Theory of radiologist interaction with instant messaging decision support tools: a sequential-explanatory study 94%
- Accuracy of preferred language data in a multi-hospital electronic health record in Toronto, Canada 94%
- Harnessing the Open Access Version of ChatGPT for Enhanced Clinical Opinions 93%
Similar papers in this journal
Similar papers in this journal
- A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text Summarisation 94%
- Bridging the Literacy Gap for Surgical Consents: An AI-Human Expert Collaborative Approach 94%
- A typology of physician input approaches to using AI chatbots for clinical decision-making: a mixed methods study 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.