Back

A Methodological Evaluation of Meta-Analyses in tDCS - Motor Learning Research

Alsalti, T.; Hussey, I.; Elson, M.; Krause, R.; Pohl, S.

2024-07-27 rehabilitation medicine and physical therapy
10.1101/2024.07.26.24311068 medRxiv
Show abstract

With transcranial direct-current stimulations (tDCS) rising popularity both in motor learning research and as a commercial product, it is becoming increasingly important that the quality of evidence on its effectiveness be evaluated. Special attention should be paid to meta-analyses, as they usually have a large impact on research and clinical practice. The aim of this study was to evaluate the methodological quality of meta-analyses estimating the effect of tDCS on motor learning with respect to reproducibility as the main focus, and reporting quality and publication bias control as secondary aspects. The three meta-analyses we reviewed largely adhered to PRISMA reporting guidelines and reported the primary effect sizes and sampling variances / confidence intervals they calculated, enabling successful reproductions of pooled effect size estimates. However, akin to previous meta-research reviews with similar aims, we found the methods and results sections of the meta-analyses to be severely underreported, which compromises the ability to judge the soundness of the methodological procedure adopted as well as its reproducibility. While publication bias detection methods were applied, the approaches chosen do not allow for well informed decisions about the presence or extent of publication bias. These results reemphasise the need to transparently report methods in meta-analyses and to meticulously evaluate their quality before and after publication.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
PLOS ONE
4510 papers in training set
Top 9%
18.8%
2
Human Brain Mapping
295 papers in training set
Top 0.8%
7.2%
3
Journal of NeuroEngineering and Rehabilitation
28 papers in training set
Top 0.1%
6.9%
4
Journal of Clinical Epidemiology
28 papers in training set
Top 0.1%
6.9%
5
Scientific Reports
3102 papers in training set
Top 18%
6.4%
6
F1000Research
79 papers in training set
Top 0.3%
4.2%
50% of probability mass above
7
Trials
25 papers in training set
Top 0.4%
3.6%
8
Annals of the New York Academy of Sciences
12 papers in training set
Top 0.1%
3.6%
9
Frontiers in Neurology
91 papers in training set
Top 2%
3.6%
10
Brain Stimulation
112 papers in training set
Top 0.6%
3.6%
11
Peer Community Journal
254 papers in training set
Top 1%
3.1%
12
PLOS Medicine
98 papers in training set
Top 2%
2.6%
13
Neurorehabilitation and Neural Repair
17 papers in training set
Top 0.2%
2.5%
14
Neuroscience & Biobehavioral Reviews
43 papers in training set
Top 0.2%
2.1%
15
PLOS Neglected Tropical Diseases
378 papers in training set
Top 3%
1.7%
16
Healthcare
16 papers in training set
Top 0.7%
1.7%
17
Scientific Data
174 papers in training set
Top 1%
1.5%
18
European Journal of Neuroscience
168 papers in training set
Top 1%
0.9%
19
Muscle & Nerve
10 papers in training set
Top 0.3%
0.8%
20
PLOS Biology
408 papers in training set
Top 18%
0.8%
21
Contemporary Clinical Trials Communications
11 papers in training set
Top 0.6%
0.8%
22
Journal of Neurophysiology
263 papers in training set
Top 1%
0.7%
23
BMJ Open
554 papers in training set
Top 13%
0.6%
24
NeuroImage: Clinical
132 papers in training set
Top 4%
0.6%
25
PeerJ
261 papers in training set
Top 17%
0.6%
26
Progress in Neuro-Psychopharmacology and Biological Psychiatry
36 papers in training set
Top 1%
0.6%
27
NeuroImage
813 papers in training set
Top 6%
0.6%
28
Journal of the Neurological Sciences
17 papers in training set
Top 1.0%
0.5%
29
Neuropsychologia
77 papers in training set
Top 2%
0.5%
30
Frontiers in Neuroscience
223 papers in training set
Top 9%
0.5%