Auxiliary modalities add no detectable discrimination or calibration over structured EHR for 30-day COPD readmission: evidence from a leakage-audited MIMIC-IV cohort
Pozza, M.; Navarin, N.; Gabrielli, S.
Show abstract
Background: Hospital readmission is a common and costly outcome in patients with chronic obstructive pulmonary disease (COPD). Multimodal deep learning models combining structured electronic health record (EHR) data with physiological, imaging, and textual data have been proposed to improve its prediction, but whether such fusion outperforms EHR data alone, once temporal-leakage safeguards are applied, remains unclear. Methods: Using a stratified MIMIC-IV cohort of COPD patients enriched to about 50% readmission (natural prevalence 18.1%; n=1,279; 895/192/192 training/validation/test), we predicted 30-day, all-cause readmission from four frozen, pre-trained encoders (electrocardiogram, chest radiograph, clinical notes, structured EHR). We audited and corrected temporal leakage in the admission-linkage pipeline of each modality, then compared three fusion architectures (naive concatenation, scalar gated fusion, EHR-anchored residual fusion) against unimodal baselines and an EHR-alone reference, using bootstrap significance testing, a missingness stress test, and calibration analysis with and without post-hoc recalibration. Results: The audit corrected three previously undetected temporal-alignment issues, affecting 5-9% of patients for clinical notes, 29-43% for chest radiographs, and 53-58% for ECG. After correction, every modality except EHR showed near-chance discrimination alone (ROC-AUC 0.46-0.53), confirmed with a non-linear adapter probe. No fusion architecture significantly outperformed the EHR-alone baseline (ROC-AUC 0.63); removing auxiliary modalities improved rather than degraded fusion performance under stress testing. The raw Brier score was lower for all three fusion architectures than for EHR-alone (about 0.24 versus 0.32), but this reflected overconfidence of the EHR-alone probe (calibration slope 0.12); after logistic recalibration fitted on the validation set, Brier scores were indistinguishable (EHR-alone 0.239; fusion 0.240-0.244; all paired bootstrap 95% CIs included zero). Conclusions: Structured EHR data alone matched the discrimination and, after recalibration, the calibration of more complex multimodal fusion for 30-day COPD readmission prediction. These findings highlight the importance of rigorous temporal-leakage auditing in multimodal clinical prediction research and suggest that reformulating this task around temporal proximity to the outcome, rather than refining the fusion mechanism further, may be more productive for future work.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Identification of acute exacerbations of chronic obstructive pulmonary disease using simple patient-reported symptoms and cough feature analysis: A diagnostic agreement study 93%
- Machine Learning Generalizability Across Healthcare Settings: Insights from multi-site COVID-19 screening 93%
- A comprehensive ML-based Respiratory Monitoring System for Physiological Monitoring & Resource Planning in the ICU 93%
Similar papers in this journal
- Use of unstructured text in prognostic clinical prediction models: a systematic review 92%
- Beyond Metrics to Methods: A Scoping Review of Large Language Models for Detection of Social Drivers of Health in Clinical Notes 92%
- Real-Time Electronic Health Record Mortality Prediction During the COVID-19 Pandemic: A Prospective Cohort Study 92%
Similar papers in this journal
- Identification of physiological adverse events using continuous vital signs monitoring during paediatric critical care transport: a novel data-driven approach 91%
- Development and Validation of a Deep Learning Model for Detecting Signs of Tuberculosis on Chest Radiographs among US-bound Immigrants and Refugees 90%
- Generalizability Challenges of Mortality Risk Prediction Models: A Retrospective Analysis on a Multi-center Database 90%
Similar papers in this journal
- Image and structured data analysis for prognostication of health outcomes in patients presenting to the Emergency Department during the COVID-19 pandemic 93%
- Personalized Predictive Models for Symptomatic COVID-19 Patients Using Basic Preconditions: Hospitalizations, Mortality, and the Need for an ICU or Ventilator 90%
- Predicting Prognosis in COVID-19 Patients using Machine Learning and Readily Available Clinical Data 89%
Similar papers in this journal
- Development and Prospective Validation of a Transparent Deep Learning Algorithm for Predicting Need for Mechanical Ventilation 91%
- Quality of Human Expert vs. Large Language Model Generated Multiple Choice Questions in the Field of Mechanical Ventilation 89%
- Rethinking Blood Eosinophils for Assessing ICS Response in COPD: A Post-Hoc Analysis from FLAME 89%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.