Back

Analysis of Practices to Promote Reproducibility and Transparency in Anaesthesiology Research: Are Important Aspects Hidden Behind the Drapes?

Okonya, O.; Rorah, D.; Tritz, D.; Umberham, B.; Wiley, M.; Vassar, M.

2019-08-12 scientific communication and education
10.1101/729129 bioRxiv
Show abstract

IntroductionReliable, high-quality research is essential to the field of anaesthesiology. Reproducibility and transparency has been investigated in the biomedical domain and in the social sciences, with both lacking to provide necessary information to reproduce the study findings. In this study, we investigated 14 indicators of reproducibility in anaesthesiology research.\n\nMethodsWe used the National Library of Medicine (NLM) catalogue to search for all anaesthesiology journals that are MEDLINE indexed and provided English texts. PubMed was searched with the list of journals to identify all publications from January 1, 2014 to December 31, 2018. We randomly sampled 300 publications that fit the inclusion criteria for our analysis. Data extraction was then conducted in a blinded, duplicate fashion using a pilot-tested Google form.\n\nResultsThe PubMed search of these journals identified 171,441 publications, with 28,310 being within the time frame. From the 300 publications sampled, 296 full-text publications were accessible. Most of the studies did not include materials or protocol availability statements. The majority of publications did not provide a data analysis script statement (121/122, 99% [98% to 100%]) or a preregistration statement (94/122, 77% [72% to 81%]).\n\nConclusionAnaesthesiology research needs to drastically improve indicators of reproducibility and transparency. By making research publically available and improving accessibility to detailed study components, primary research can be reproduced in subsequent studies and help contribute to the development of new practice guidelines.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
PLOS Biology
408 papers in training set
Top 0.1%
28.3%
2
PLOS ONE
4510 papers in training set
Top 8%
19.0%
3
Journal of General Internal Medicine
20 papers in training set
Top 0.1%
8.6%
50% of probability mass above
4
Journal of Clinical Epidemiology
28 papers in training set
Top 0.1%
6.5%
5
BMJ Open
554 papers in training set
Top 5%
3.7%
6
Journal of the American Medical Informatics Association
61 papers in training set
Top 1.0%
2.4%
7
BMC Medical Education
20 papers in training set
Top 0.5%
1.9%
8
Medicine
30 papers in training set
Top 1%
1.7%
9
Wellcome Open Research
57 papers in training set
Top 0.8%
1.7%
10
Archives of Clinical and Biomedical Research
28 papers in training set
Top 0.7%
1.7%
11
Philosophical Transactions of the Royal Society B
51 papers in training set
Top 3%
1.5%
12
Trials
25 papers in training set
Top 1.0%
1.4%
13
BMC Medical Research Methodology
43 papers in training set
Top 0.8%
1.4%
14
British Journal of Anaesthesia
14 papers in training set
Top 0.5%
1.4%
15
Systematic Reviews
11 papers in training set
Top 0.3%
1.3%
16
Heliyon
146 papers in training set
Top 3%
1.3%
17
BMC Medicine
163 papers in training set
Top 5%
1.3%
18
PLOS Global Public Health
293 papers in training set
Top 4%
1.2%
19
JAMA Network Open
127 papers in training set
Top 3%
0.9%
20
F1000Research
79 papers in training set
Top 3%
0.9%
21
PeerJ
261 papers in training set
Top 13%
0.8%
22
Frontiers in Veterinary Science
30 papers in training set
Top 1%
0.7%
23
eLife
5422 papers in training set
Top 63%
0.5%
24
eneuro
389 papers in training set
Top 11%
0.5%