Back

Reproducibility Policies in Cardiology Journals: The REPLICA Cross-Sectional Study

Helal, L.; Ferrari, F.; Rice, D. B.; Ahmadzai, N.; Skidmore, B.; Umpierre, D.; Moher, D.

2022-08-04 cardiovascular medicine
10.1101/2022.08.04.22278423 medRxiv
Show abstract

ImportanceTransparency and data sharing are valuable practices in research, contributing to improved precision and flexibility in cumulative evidence; and ultimately expanding the research ecosystem by addressing one of the philosophical research norms that implies that knowledge belongs to society. ObjectivesThe objective of the Reproducibility Policies In Cardiology Journals (REPLICA) study was to estimate the proportions of policies and guidance for reproducibility and transparency practices among Cardiology journals, as well as to determine details of completeness of reporting and data sharing conditions whenever disclosed. DesignCross-sectional analysis. SettingCross-sectional study through analyses of journals deposited in the National Library of Medicine (NLM) Catalog tagged with the "Cardiology" and "Vascular Diseases" entry terms. Eligibility CriteriaCardiology journals from the NLM Catalog database that published at least one randomized clinical trial in 2018. Journals that published articles in English, Spanish, French, or Portuguese and were available in MEDLINE/PubMed were eligible for inclusion. ExposuresThe exposures were mainly related to journals characteristics such as publisher operations characteristics (e.g., journal access only by subscription), indexation in the DOAJPlus, requirement for registration for RCTs, and others. Main outcomes and measuresWe prespecified a primary composite outcome composed of data-sharing policy or guidance. Secondary outcomes were proportions of reporting guidelines within the journals instructions for the authors section (e.g., CONSORT), and also other components of sharing practices. ResultsWe assessed 148 journals. Of them, 74 (50.0%, 95%CI 41.9% to 58.1%) presented policy or guidance for data sharing. We found guidance for data sharing in 68 journals (47.5% 95%CI 39.4% to 55.8%). Notably, among them, only two mentioned sharing individual participant data (IPD). Regarding guidelines for article reporting, we identified that 132 journals displayed guidance for authors, in which 27 (20.45%, 95%CI 14.34% to 28.29%) had CONSORT and EQUATOR Network guidance content. Conclusion and relevanceIn summary, we found a mild proportion of policies and guidance for data-sharing. Moreover, transparency practices inclined to RCTs are suboptimal, as mirrored by the very low prevalence of IPD data-sharing policy and guidance as well as specific reporting guidelines instructions for RCTs. Key PointsO_ST_ABSQuestionC_ST_ABSWhat is the proportion of journals displaying policies and guidance about data sharing in cardiology journals? FindingsWe found a low prevalence of policy and guidance for data sharing in Cardiology journals, as well as transparency and reproducibility practices; details, individual participant data sharing, registration, and completeness of reporting, for example. MeaningJournals play a role in driving reproducibility and transparency among scientific areas. Stakeholders involved in the editorial processes should be open to understand the valuable impact of data-sharing practices and learn how to implement such mechanisms, that being the case.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
Heart
10 papers in training set
Top 0.1%
17.1%
2
PLOS ONE
4510 papers in training set
Top 14%
14.0%
3
BMJ Open
554 papers in training set
Top 1%
14.0%
4
Open Heart
19 papers in training set
Top 0.1%
7.0%
50% of probability mass above
5
BMC Medicine
163 papers in training set
Top 0.6%
6.2%
6
Medicine
30 papers in training set
Top 0.7%
2.7%
7
BMJ Global Health
98 papers in training set
Top 1%
2.7%
8
The American Journal of Cardiology
15 papers in training set
Top 0.8%
2.0%
9
Healthcare
16 papers in training set
Top 0.4%
2.0%
10
BJGP Open
12 papers in training set
Top 0.3%
1.8%
11
BMJ
49 papers in training set
Top 0.6%
1.7%
12
Frontiers in Cardiovascular Medicine
49 papers in training set
Top 2%
1.7%
13
PLOS Medicine
98 papers in training set
Top 3%
1.6%
14
British Journal of General Practice
22 papers in training set
Top 0.3%
1.3%
15
Journal of the American Medical Informatics Association
61 papers in training set
Top 1%
1.3%
16
PLOS Biology
408 papers in training set
Top 15%
1.1%
17
Nature Communications
4913 papers in training set
Top 60%
0.9%
18
European Heart Journal - Digital Health
15 papers in training set
Top 0.6%
0.7%
19
Journal of the American Heart Association
119 papers in training set
Top 4%
0.7%
20
DIGITAL HEALTH
12 papers in training set
Top 0.7%
0.7%
21
BMJ Health & Care Informatics
13 papers in training set
Top 1%
0.6%
22
Journal of Clinical Epidemiology
28 papers in training set
Top 0.7%
0.6%
23
European Journal of Preventive Cardiology
13 papers in training set
Top 1%
0.6%
24
BMC Cardiovascular Disorders
14 papers in training set
Top 2%
0.6%