Merging Adaptive Designs with Dynamic Infectious Disease Models Allows Faster and more Accurate Diagnostic Test Accuracy Studies in the Case of an Epidemic
Köster, D.; Chaturvedi, M.; Rübsamen, N.; Bapda, M.; Karch, A.; Zapf, A.
Show abstract
BackgroundDuring epidemics with emerging infections, diagnostic tests directly inform model-based decision-making and thereby shape infection control strategies. However, diagnostic accuracy studies (DTA) assessing the validity of these tests must be conducted under severe time and data constraints. We investigated whether the integration of adaptive designs and of epidemic spread modelling for prevalence prediction can accelerate DTA studies during epidemics with emerging infections without compromising statistical validity. MethodsWe compared three designs in a large-scale simulation study using a COVID-19 use case: a fixed design; a standard adaptive design with unblinded interim analysis enabling early stopping or sample size adaptation; and an adaptive design additionally integrating a prevalence projection model to inform sample size re-estimation. Data-generating mechanisms were based on infectious disease models and realistic recruitment constraints. As decision rules we used in one simulation line WHO criteria for DTA studies for COVID-19 and in the other one more liberal performance thresholds. Across 1,440 factorial scenarios (5,000 replications each), we evaluated study duration, sample size requirements, statistical power as well as bias in estimates. ResultsBoth adaptive designs enabled substantial operational gains. For the WHO thresholds, early stopping (for futility or infeasibility) occurred in 80% of adaptive simulations; early efficacy stops were rare. Under more liberal thresholds, early termination was less frequent, leading to more studies reaching final analysis. Required sample sizes under WHO criteria frequently exceeded 10,000 participants, making fixed designs practically infeasible. Adaptive designs identified infeasible scenarios early and avoided continuation. Under liberal thresholds, recalculated sample sizes in adaptive designs closely tracked theoretical needs up to the upper quartile, in contrast to fixed designs mirroring the low power commonly observed in real-world pandemic studies. Overall, adaptive designs shortened study duration when stopping early and prevented continuation of unpromising trials. DiscussionAdaptive designs in DTA studies during epidemics with emerging pathogens improve feasibility by preventing unrealistic recruitment targets and enabling early abandonment of non-viable scenarios. When realistic performance thresholds are used, adaptive re-estimation produces sample sizes more aligned with statistical requirements without systematic operational penalties. These findings support the adoption of adaptive approaches in confirmatory DTA studies for emerging infections as a pragmatic response to time pressure and uncertainty.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Quantitative bias analysis for mismeasured variables in health research: a review of software tools 93%
- External control arm analysis: an evaluation of propensity score approaches, G-computation, and doubly debiased machine learning 93%
- Comparison of Bayesian networks, G-estimation and linear models to estimate causal treatment effects in aggregated N-of-1 trials 93%
Similar papers in this journal
- Using numerical modelling and simulation to assess the ethical burden in clinical trials and how it relates to the proportion of responders in a trial sample 94%
- A method of back-calculating the log odds ratio and standard error of the log odds ratio from the reported group-level risk of disease 94%
- Modelling the impact of behavioural interventions during pandemics: A systematic review 93%
Similar papers in this journal
- Controlled evaLuation of Angiotensin Receptor Blockers for COVID-19 respIraTorY disease (CLARITY): Statistical analysis plan for a randomised controlled Bayesian adaptive sample size trial 95%
- Graphing and reporting heterogeneous treatment effects through reference classes 94%
- Machine learning for randomised controlled trials: identifying treatment effect heterogeneity with strict control of type I error 93%
Similar papers in this journal
Similar papers in this journal
- Use of estimands in cluster randomised trials: a review 92%
- Estimating Counterfactual Placebo HIV Incidence in HIV Prevention Trials Without Placebo Arms Based on Markers of HIV Exposure 92%
- Using simulated infectious disease outbreaks to guide the design of individually randomized vaccine trials 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.