Back

Preregistration and Credibility of Clinical Trials

Decker, C.; Ottaviani, M.

2023-05-23 health policy
10.1101/2023.05.22.23290326
Show abstract

Preregistration at public research registries is considered a promising solution to the credibility crisis in science, but empirical evidence of its actual benefit is limited. Guaranteeing research integrity is especially vital in clinical research, where human lives are at stake and investigators might suffer from financial pressure. This paper analyzes the distribution of p-values from pre-approval drug trials reported to ClinicalTrials.gov, the largest registry for research studies in human volunteers, conditional on the preregistration status. The z-score density of non-preregistered trials displays a significant upward discontinuity at the salient 5% threshold for statistical significance, indicative of p-hacking or selective reporting. The density of preregistered trials appears smooth at this threshold. With caliper tests, we establish that these differences between preregistered and non-preregistered trials are robust when conditioning on sponsor fixed effects and other design features commonly indicative of research integrity, such as blinding and data monitoring committees. Our results suggest that preregistration is a credible signal for the integrity of clinical trials, as far as it can be assessed with the currently available methods to detect p-hacking.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
PLOS ONE
based on 1737 papers
Top 26%
16.5%
2
Scientific Reports
based on 701 papers
Top 3%
16.5%
3
Proceedings of the National Academy of Sciences
based on 100 papers
Top 0.4%
12.0%
4
Statistics in Medicine
based on 17 papers
Top 0.1%
8.1%
50% of probability mass above
5
Research Synthesis Methods
based on 17 papers
Top 0.3%
4.8%
6
eLife
based on 262 papers
Top 7%
3.0%
7
BMC Medical Research Methodology
based on 41 papers
Top 1%
2.7%
8
American Journal of Epidemiology
based on 54 papers
Top 2%
2.5%
9
PLOS Biology
based on 14 papers
Top 0.1%
2.5%
10
Nature Medicine
based on 88 papers
Top 5%
2.4%
11
Journal of Clinical and Translational Science
based on 11 papers
Top 0.7%
1.9%
12
JAMA Network Open
based on 125 papers
Top 10%
1.7%
13
Nature Communications
based on 483 papers
Top 30%
1.7%
14
PNAS Nexus
based on 22 papers
Top 0.3%
1.4%
15
International Journal of Infectious Diseases
based on 115 papers
Top 11%
1.4%
16
F1000Research
based on 28 papers
Top 3%
1.3%
17
Royal Society Open Science
based on 49 papers
Top 4%
1.3%
18
Nature Human Behaviour
based on 18 papers
Top 1%
1.3%
19
Journal of the American Medical Informatics Association
based on 53 papers
Top 6%
0.9%
20
Social Science & Medicine
based on 15 papers
Top 2%
0.9%
21
Epidemiology
based on 26 papers
Top 2%
0.9%
22
BMC Medicine
based on 155 papers
Top 23%
0.7%
23
Pharmacoepidemiology and Drug Safety
based on 12 papers
Top 2%
0.7%
24
Epidemiology and Infection
based on 80 papers
Top 12%
0.7%
25
Communications Medicine
based on 63 papers
Top 4%
0.7%