Back

Is the replication crisis a problem for biologists? A geometric morphometric approach.

Vrdoljak, J.; Sanchez, K. I.; Arreola-Ramos, R.; Diaz Huesa, E. G.; Villagra, A.; Avila, L. J.; Morando, M.

2019-12-02 scientific communication and education
10.1101/862052 bioRxiv
Show abstract

Replicability of findings is the key factor of scientific reliability. However, literature on this topic is scarce and apparently taboo for large scientific areas. Some authors named the failure to reproduce scientific findings replication crisis. Geometric morphometrics, a vastly used technique, is especially silent on replication crisis concern. Nevertheless, some works pointed out that sharing morphogeometric information is not a trivial fact, but need to be careful and meticulous. Here, we investigated the replicability of geometric morphometrics protocols on complex shapes and measurement error extension in three different types of taxa, as well as the potentiality of these protocols to discriminate among closely related species. We found a wide range of replication error that contributed from 19.5% to 60% of the total variation. Although, measurement error decreased with the complexity of the quantified shape, it often maintained high values. All protocols were able to discriminate between species, but more morphogeometric information does not imply better performance. We present evidence of replication crisis in life sciences and highlight the need to explore in deep different sources of variation that could lead to low replicability findings. Lastly, we enunciate some recommendations in order to improve the replicability and reliability of scientific findings.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
PLOS ONE
4510 papers in training set
Top 9%
18.8%
2
Ecological Informatics
29 papers in training set
Top 0.1%
17.7%
3
Ecology and Evolution
232 papers in training set
Top 0.1%
10.2%
4
PeerJ
261 papers in training set
Top 0.2%
8.5%
50% of probability mass above
5
Heliyon
146 papers in training set
Top 0.1%
6.9%
6
Scientific Reports
3102 papers in training set
Top 36%
3.6%
7
PLOS Computational Biology
1633 papers in training set
Top 13%
2.4%
8
Royal Society Open Science
193 papers in training set
Top 1%
2.1%
9
eLife
5422 papers in training set
Top 38%
1.9%
10
Methods in Ecology and Evolution
160 papers in training set
Top 1%
1.9%
11
Philosophical Transactions of the Royal Society B
51 papers in training set
Top 3%
1.7%
12
Peer Community Journal
254 papers in training set
Top 3%
1.2%
13
BMC Ecology and Evolution
49 papers in training set
Top 1%
1.2%
14
PLANTS, PEOPLE, PLANET
21 papers in training set
Top 0.5%
1.1%
15
Genomics, Proteomics & Bioinformatics
171 papers in training set
Top 5%
1.0%
16
BMC Bioinformatics
383 papers in training set
Top 6%
0.9%
17
Frontiers in Marine Science
55 papers in training set
Top 0.9%
0.9%
18
Molecular Ecology Resources
161 papers in training set
Top 0.9%
0.9%
19
Plant Direct
81 papers in training set
Top 2%
0.8%
20
Animals
20 papers in training set
Top 0.9%
0.8%
21
Applications in Plant Sciences
21 papers in training set
Top 0.3%
0.8%
22
GigaScience
172 papers in training set
Top 3%
0.8%
23
PLOS Biology
408 papers in training set
Top 21%
0.7%
24
Entropy
20 papers in training set
Top 0.5%
0.6%
25
Environmental DNA
49 papers in training set
Top 0.4%
0.6%
26
New Phytologist
309 papers in training set
Top 5%
0.6%
27
Systematic Biology
121 papers in training set
Top 0.5%
0.6%
28
Journal of Systematics and Evolution
11 papers in training set
Top 0.3%
0.6%
29
Plant Methods
39 papers in training set
Top 1.0%
0.5%