Detecting Algorithmic Bias in ICU Clinical Decision: A Doubly-Robust Framework for Auditing Treatment Recommendation Disparities
Zhou, Y.-H.; Sun, G.
Show abstract
Clinical decision support systems increasingly guide ICU care, but may perpetu-ate or amplify existing healthcare disparities. We develop a doubly-robust statistical framework for detecting and quantifying algorithmic bias in ICU treatment recommen-dations. Rather than prescribing treatment allocation, our approach audits existing clinical decision support systems to identify disparities in predicted treatment benefits across demographic groups. Analyzing 193,683 patients from the eICU database, we demonstrate the frameworks ability to detect systematic biases. For age-based anal-ysis, we identify a 5.1 percentage point mortality disparity with differential predicted treatment effects (3.2pp younger vs. 1.8pp older patients). For race-based analysis, severity-adjusted outcome disparities (average 2.2pp, reaching 5.6pp at high severity) suggest potential differences in care quality or algorithmic recommendations despite similar aggregate outcomes. We quantify how different fairness metrics (demographic parity, equalized odds, calibration) reveal distinct bias patterns, providing guidance for bias auditing in clinical AI systems. This framework enables healthcare systems to identify and address algorithmic bias before deployment, supporting more equitable clinical decision support.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Investigating Ethical Tradeoffs in Crisis Standards of Care through Simulation of Ventilator Allocation Protocols 95%
- Derivation and validation of a triage tool for acutely ill adults with suspected COVID-19: The PRIEST observational cohort study 93%
- A comparison of machine learning models versus clinical evaluation for mortality prediction in patients with sepsis 93%
Similar papers in this journal
- Clinical Utility of Automatable Prediction Models for Improving Palliative and End-Of-Life Care Outcomes: Towards Routine Decision Analysis Before Implementation 95%
- Real-Time Electronic Health Record Mortality Prediction During the COVID-19 Pandemic: A Prospective Cohort Study 95%
- Validation of a Derived International Patient Severity Algorithm to Support COVID-19 Analytics from Electronic Health Record Data 95%
Similar papers in this journal
- Automated Interpretable Discovery of Heterogeneous Treatment Effectiveness: A Covid-19 Case Study 94%
- Improving Hospital Readmission Prediction using Individualized Utility Analysis 94%
- Demonstrating the Consequences of Learning Missingness Patterns in Early Warning Systems for Preventative Health Care: A Novel Simulation and Solution 93%
Similar papers in this journal
- Contrasting factors associated with COVID-19-related ICU admission and death outcomes in hospitalised patients by means of Shapley values 92%
- Modeling Decision-Making Under Uncertainty with Qualitative Outcomes 91%
- A model-based evaluation of the efficacy of COVID-19 social distancing, testing and hospital triage policies 91%
Similar papers in this journal
- Implicit bias in Critical Care Data: Factors affecting sampling frequencies and missingness patterns of clinical and biological variables in ICU Patients 96%
- OASIS+: leveraging machine learning to improve the prognostic accuracy of OASIS severity score for predicting in-hospital mortality 94%
- Development and Validation of ‘Patient Optimizer’ (POP) Algorithms for Predicting Surgical Risk with Machine Learning 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.