An AI Competency Framework for Emergency Medicine: A Multiphase Consensus Process
Preiksaitis, C. M.; Makutonin, M.; Abu-Jubara, D.; Chang, W.-T. W.; Cooney, R.; Diercks, D.; Kundurti, N.; Kwan, B.; Liu, R.; Lozano, M.; Mackey, C.; Moukaddem, M.; Pearce, E.; Pelletier, J.; Rowh, M.; Taylor, R. A.; Rose, C.
Show abstract
Artificial intelligence (AI) is increasingly embedded in U.S. emergency department workflows, but no medical specialty has defined what competent use of these tools requires of its physicians. Existing accreditation requirements are silent on AI, and parallel national efforts span the learning continuum but are intentionally specialty-agnostic. As one output of a working group of the 2026 Society for Academic Emergency Medicine (SAEM) Artificial Intelligence Consensus Conference, we developed an emergency medicine-specific framework for AI competency. We employed a multiphase consensus design: a Nominal Group Technique session generated themes from a curated set of clinical AI scenarios, and a two-round modified Delphi process (panel n = 13 across 12 academic medical centers), separated by a consolidation videoconference, evaluated and extended the framework. A priori consensus required [≥]70% of panelists rating [≥]4 on a 5-point Likert scale ([≥]75% for themes) with interquartile range [≤]1; we followed established Delphi reporting guidance. The framework comprises 5 themes (Communicating about AI, Understanding appropriate use cases, Interacting with AI, AI risk management, Cognitive impacts of AI), 5 derived competencies (one-to-one theme-to-competency mapping endorsed by 12 of 13 panelists), 19 subthemes, and 10 retained clinical scenarios. All themes, derived competencies, and rated subthemes met consensus thresholds; 9 of 10 scenarios reached consensus, with 1 retained as a future-state operational model. Two cross-cutting conceptual frames emerged: pre-emptive versus post-hoc AI integration, and tiered competencies as an articulated need rather than a pre-specified answer. This is, to our knowledge, the first specialty-specific AI competency framework for a United States medical specialty with quantitative content validity evidence from expert consensus. It provides a structural target for emergency medicine curriculum development, assessment design, and faculty development, with downstream priorities including stage-specific competency assignment, assessment instrument development, and periodic re-evaluation as AI deployment evolves.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Medical students' perceptions towards artificial intelligence in education and practice: A multinational, multicenter cross-sectional study 93%
- Large language models for generating medical examinations: systematic review 91%
- Team-Based Learning Versus Lecture-Based Instruction for Chest Radiograph Interpretation in Physician Associate Education: A Quasi-Experimental Study 91%
Similar papers in this journal
- Transparent comparisons of Emergency-Department prioritization policies: integrating tail risk, target attainment, and utility analysis 92%
- Protocol For Human Evaluation of Artificial Intelligence Chatbots in Clinical Consultations 92%
- The Mastery Rubric for Bioinformatics: supporting design and evaluation of career-spanning education and training 90%
Similar papers in this journal
- A typology of physician input approaches to using AI chatbots for clinical decision-making: a mixed methods study 91%
- Bridging the Literacy Gap for Surgical Consents: An AI-Human Expert Collaborative Approach 91%
- From Tool to Teammate: A Randomized Controlled Trial of Clinician-AI Collaborative Workflows for Diagnosis 90%
Similar papers in this journal
- A Modified Delphi Consensus-based Comprehensive Checklist and Angoff Standard for Assessment of Competency in Brain Death/Death by Neurologic Criteria Determination 91%
- An international factorial vignette-based survey of intubation decisions in acute hypoxemic respiratory failure 89%
- Prone Positioning in a North American Cohort of Hypoxemic Patients on Mechanical Ventilation 87%
Similar papers in this journal
- Performance of ChatGPT, GPT-4, and Google Bard on a Neurosurgery Oral Boards Preparation Question Bank 92%
- Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations 91%
- A Porcine Model of Peripheral Nerve Injury Enabling Ultra-Long Regenerative Distances: Surgical Approach, Recovery Kinetics, and Clinical Relevance 81%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.