Safety-Relevant Biomedical Machine Learning Should Adopt Stability-First Reporting
Zainal, Z. A.; Kavehei, O.; Aguilar, I.; Herbozo Contreras, L. F.; Huang, Z.
Show abstract
Biomedical Machine Learning (ML) is increasingly evaluated through Independent and Identically Distributed (IID) benchmarks, even when deployment involves irregular observation, missingness, distribution shift, and high failure costs. This position paper argues for a stability-oriented reporting standard for safety-relevant biomedical ML. The central requirement is not a specific model class or optimizer, but auditable evidence: performance should be reported under clinically plausible perturbations such as thinning, timestamp jitter, bursty missingness, channel dropout, and Signal-to-Noise Ratio (SNR) shift. When authors invoke training-stability diagnostics, those diagnostics should be hazard-linked: their assumptions, operational meaning, and relationship to stress-test degradation should be stated explicitly. We use controlled mechanism probes to illustrate two hazards that IID scores can hide: observation-process dependence under irregular sampling, and perturbation sensitivity associated with high-curvature training regimes such as Edge of Stability (EoS). We do not propose Neural ODEs, continuous-time models, Sharpness-Aware Minimization (SAM), or EoS metrics as default prescriptions. Instead, we propose a minimum reporting standard that makes robustness claims testable and supports escalation to more complex modelling or optimization only when stress tests justify the cost.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Generalising uncertainty improves accuracy and safety of deep learning analytics applied to oncology 93%
- Synthetic data for privacy-preserving clinical risk prediction 92%
- Evaluation of Domain Generalization and Adaptation on Improving Model Robustness to Temporal Dataset Shift in Clinical Medicine 92%
Similar papers in this journal
- Generation of realistic synthetic data using multimodal neural ordinary differential equations 92%
- Enhancing Privacy-Preserving Deployable Large Language Models for Perioperative Complication Detection: A Targeted Strategy with LoRA Fine-tuning 92%
- Privacy-first health research with federated learning 91%
Similar papers in this journal
- Prediction-powered Inference for Clinical Trials 92%
- Advancing data science in drug development through an innovative computational framework for data sharing and statistical analysis 90%
- Towards reduction in bias in epidemic curves due to outcome misclassification through Bayesian analysis of time-series of laboratory test results: Case study of COVID-19 in Alberta, Canada and Philadelphia, USA 90%
Similar papers in this journal
- An antimicrobial drug recommender system using MALDI-TOF MS and dual-branch neural networks 90%
- An emerging view of neural geometry in motor cortex supports high-performance decoding 90%
- Using normative models pre-trained on cross-sectional data to evaluate intra-individual longitudinal changes in neuroimaging data 90%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.