Aligning Artificial Intelligence Prediction Targets with Clinical Workflows Using Human Centered Design Methods
Mai, M. V.; Shin, H. S.; Muthu, N.; Braykov, N. P.; McCarter, A.; Hilsman, J.; Orenstein, E.; Hu, X.; Kandaswamy, S.
Show abstract
Artificial intelligence models in healthcare often fail to improve patient outcomes despite strong predictive performance because they are frequently developed with limited understanding of clinical workflows and system implementation. We demonstrate a human-centered design approach to define prediction targets before model development, ensuring alignment with actionable clinical interventions. Using pediatric acute kidney injury as a case study, we convened a multidisciplinary working group and applied three complementary methods: user stories to elicit role-specific prediction targets, a People, Environment, Technology, and Tasks (PETT) Scan to analyze sociotechnical system factors, and process mapping to identify workflow leverage points. This approach revealed that different clinical roles require distinct prediction targets, with shared barriers including inadequate monitoring practices, poor visibility of at-risk patients, and unclear trajectories for kidney injury progression. By integrating clinical context before algorithm development, we identified high-impact prediction targets that support actionable interventions for hospitalists, nephrologists, and intensivists, demonstrating how human-centered design can bridge technical model performance and real-world clinical utility.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Development and preliminary testing of Health Equity Across the AI Lifecycle (HEAAL): A framework for healthcare delivery organizations to mitigate the risk of AI solutions worsening health inequities 95%
- Raising awareness of potential biases in medical machine learning: Experience from a Datathon 94%
- Theory of radiologist interaction with instant messaging decision support tools: a sequential-explanatory study 93%
Similar papers in this journal
- A Simple Electronic Medical Record System Designed for Research 92%
- Development of a COVID-19 Application Ontology for the ACT Network 91%
- MMFP-Tableau: Enabling Precision Mitochondrial Medicine through Integration, Visualization, and Analytics of Clinical and Research Health System Electronic Data 91%
Similar papers in this journal
- User Testing of a Diagnostic Decision Support System with Machine-assisted Chart Review to Facilitate Clinical Genomic Diagnosis 93%
- Connecting Artificial Intelligence and Primary Care Challenges: Findings from a Multi-Stakeholder Collaborative Consultation 93%
- Development of a customised data management system for a COVID-19-adapted colorectal cancer pathway 92%
Similar papers in this journal
- Demonstrating the Consequences of Learning Missingness Patterns in Early Warning Systems for Preventative Health Care: A Novel Simulation and Solution 93%
- Signal from the Noise: A Mixed Methods Process Mining Approach to Evaluate Care Pathways. 92%
- EHR-QC: A streamlined pipeline for automated electronic health records standardisation and preprocessing to predict clinical outcomes 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.