Back

A New Paper Framework to Increase Reproducibility: Example Relating to Web Pharmacovigilance During COVID-19 in Italy

Rovetta, A.; Castaldo, L.

2022-05-10 epidemiology
10.1101/2022.05.03.22274607 medRxiv
Show abstract

Reproducibility and transparency represent some of the main problems of scientific publishing. Currently, the editorial requests of academic journals and peer reviewers can divert the authors attention from an accurate description of the methods adopted, thus compromising these fundamental scientific aspects. This paves the way for the voluntary falsification of data to obtain striking results. Furthermore, the excessive expansion of introduction and discussion sections increases the likelihood of introducing evaluation bias. Since peer reviewers are generally unpaid for their work, they are not required to reproduce the analysis of the studies they review but only to assess methodological accuracy, reproducibility, and plausibility. Therefore, this paper aims to emphasize that the methods and results sections are the central parts of quantitative analysis. In this regard, we firmly believe that the peer review process should, whenever possible, reproduce the analysis from scratch. Consequently, authors must be required to provide a simple and straightforward tutorial to reproduce the analysis as it was conceived both methodologically and chronologically. Ideas, insights, and discussions among the authors must also be reported. This complete description can be provided as integrative material published with the main manuscript, which is nothing more than a summary of methods and results. Such a procedure would represent the first step to improving the quality of scientific publications, waiting for unscientific concepts such as "publish or perish" to be eradicated from the academic world. In this manuscript, we provide a framework that can serve as a fully reproducible and transparent example of analysis. The aim is to investigate the Italian netizens web interest in paracetamol, ibuprofen, and nimesulide from 2015 to 2022, searching for causal associations with the fever symptom and COVID-19. The infodemiological tool "Google Trends" has been used to collect the data. Correlational analysis showed plausible causal associations between paracetamol, ibuprofen, and fever due to seasonal flu and COVID-19 and, although to a minor extent, COVID-19 vaccines side effects. Paracetamol was the most historically searched substance. However, the trend of ibuprofen has caught up with that of paracetamol in 2022. Interest in paracetamol, ibuprofen, and nimesulide increased substantially during the COVID-19 pandemic period. We conclude that web pharmacovigilance via Google Trends can provide relevant evidence for monitoring drug intake in relation to epidemiologically significant events such as epidemics and mass vaccination campaigns.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

1
PLOS ONE
4510 papers in training set
Top 13%
14.6%
2
Frontiers in Pharmacology
100 papers in training set
Top 0.2%
10.6%
3
JMIRx Med
31 papers in training set
Top 0.1%
9.3%
4
Journal of Clinical Medicine
91 papers in training set
Top 1%
4.0%
5
International Journal of Environmental Research and Public Health
124 papers in training set
Top 2%
4.0%
6
Scientific Reports
3102 papers in training set
Top 33%
3.7%
7
Frontiers in Medicine
113 papers in training set
Top 2%
3.1%
8
International Journal of Medical Informatics
25 papers in training set
Top 0.6%
2.4%
50% of probability mass above
9
Frontiers in Public Health
140 papers in training set
Top 3%
2.4%
10
BMJ Open
554 papers in training set
Top 7%
2.4%
11
PeerJ
261 papers in training set
Top 7%
1.7%
12
Computational and Structural Biotechnology Journal
216 papers in training set
Top 4%
1.7%
13
BMC Medical Research Methodology
43 papers in training set
Top 0.6%
1.7%
14
Computers in Biology and Medicine
120 papers in training set
Top 2%
1.5%
15
Pharmacoepidemiology and Drug Safety
13 papers in training set
Top 0.2%
1.5%
16
JMIR Public Health and Surveillance
45 papers in training set
Top 2%
1.4%
17
eLife
5422 papers in training set
Top 47%
1.4%
18
Journal of Medical Internet Research
85 papers in training set
Top 3%
1.2%
19
Scientific Data
174 papers in training set
Top 2%
1.1%
20
British Journal of Clinical Pharmacology
21 papers in training set
Top 0.5%
1.0%
21
The American Journal of Tropical Medicine and Hygiene
60 papers in training set
Top 3%
1.0%
22
BMJ Global Health
98 papers in training set
Top 2%
0.9%
23
JMIR Research Protocols
18 papers in training set
Top 1%
0.9%
24
Wellcome Open Research
57 papers in training set
Top 2%
0.9%
25
Addiction Neuroscience
17 papers in training set
Top 0.4%
0.8%
26
Archives of Clinical and Biomedical Research
28 papers in training set
Top 2%
0.8%
27
BMC Genomics
328 papers in training set
Top 5%
0.8%
28
Metabolites
50 papers in training set
Top 1%
0.8%
29
Healthcare
16 papers in training set
Top 2%
0.8%
30
Clinical and Translational Science
21 papers in training set
Top 1%
0.8%