Back

Publication bias in otorhinolaryngology meta-analyses in 2021

Mohammadian, F.; Bastaninejad, S.; Irani, S.

2023-07-25 otolaryngology
10.1101/2023.07.24.23293129 medRxiv
Show abstract

IntroductionOne concern in meta-analyses is the presence of publication bias (PB) which leads to the dissemination of inflated results. In this study, we assessed how much the meta-analyses in the field of otorhinolaryngology in 2021 evaluated the presence of PB. MethodsSix of the most influential journals in the field were selected. A search was conducted, and data were extracted from the included studies. In cases where PB was not assessed by the authors, we evaluated the risk of its presence by designing funnel plots and performing statistical tests. Results75 systematic reviews were included. 51% of them used at least one method for assessing the risk of PB, with the visual inspection of a funnel plot being the most frequent method used. 29% of the studies reported a high risk of PB presence. We replicated the results of 11 meta-analyses that did not assess the risk of PB and found that 63.6% were at high risk. DiscussionOur results indicate that systematic reviews published in some of the most influential journals in the field do not implement enough measures in their search strategies to reduce the risk of PB, nor do they assess the risk of its presence.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.