Preregistration and Credibility of Clinical Trials
Decker, C.; Ottaviani, M.
Show abstract
Preregistration at public research registries is considered a promising solution to the credibility crisis in science, but empirical evidence of its actual benefit is limited. Guaranteeing research integrity is especially vital in clinical research, where human lives are at stake and investigators might suffer from financial pressure. This paper analyzes the distribution of p-values from pre-approval drug trials reported to ClinicalTrials.gov, the largest registry for research studies in human volunteers, conditional on the preregistration status. The z-score density of non-preregistered trials displays a significant upward discontinuity at the salient 5% threshold for statistical significance, indicative of p-hacking or selective reporting. The density of preregistered trials appears smooth at this threshold. With caliper tests, we establish that these differences between preregistered and non-preregistered trials are robust when conditioning on sponsor fixed effects and other design features commonly indicative of research integrity, such as blinding and data monitoring committees. Our results suggest that preregistration is a credible signal for the integrity of clinical trials, as far as it can be assessed with the currently available methods to detect p-hacking.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Use of estimands in cluster randomised trials: a review 93%
- Estimating Counterfactual Placebo HIV Incidence in HIV Prevention Trials Without Placebo Arms Based on Markers of HIV Exposure 93%
- Dynamic methods for ongoing assessment of site-level risk in risk-based monitoring of clinical trials: a scoping review 93%
Similar papers in this journal
- ZIBGLMM: Zero-Inflated Bivariate Generalized Linear Mixed Model for Meta-Analysis with Double-Zero-Event Studies 94%
- Evaluation of statistical methods used to meta-analyse results from interrupted time series studies: a simulation study 94%
- Treatment recommendations based on Network Meta-Analysis: rules for risk-averse decision-makers 93%
Similar papers in this journal
- Trials that turn from retrospectively registered to prospectively registered: A cohort study of ‘retroactively prospective’ clinical trial registration using history data 95%
- Controlled evaLuation of Angiotensin Receptor Blockers for COVID-19 respIraTorY disease (CLARITY): Statistical analysis plan for a randomised controlled Bayesian adaptive sample size trial 94%
- Graphing and reporting heterogeneous treatment effects through reference classes 93%
Similar papers in this journal
- Using numerical modelling and simulation to assess the ethical burden in clinical trials and how it relates to the proportion of responders in a trial sample 95%
- Analysis of clinical trial registry entry histories using the novel R package cthist 95%
- Data-driven Prior Elicitation for Bayes Factors in Cox Regression for Nine Subfields in Biomedicine 95%
Similar papers in this journal
- External control arm analysis: an evaluation of propensity score approaches, G-computation, and doubly debiased machine learning 95%
- Approaches in Analyzing Predictors of Trial Failure: A Scoping Review and Meta-epidemiological study 94%
- Investigator-initiated versus industry-sponsored trials – Visibility and relevance of randomized controlled trials in clinical practice guidelines (IMPACT) 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.