Back

Enhancing Reproducibility Through Bioimage Analysis: The Significance of Effect Sizes and Controls

Barry, D. J.; Marcotti, S.; Gerontogianni, L.; Kelly, G.

2025-02-11 cell biology
10.1101/2025.02.10.637409 bioRxiv
Show abstract

Bioimage analysis is a powerful tool for investigating complex biological processes, but its robustness depends on technical precision and rigorous experimental design. In particular, the use of appropriate controls and experimental repetition is critical for drawing meaningful conclusions. However, both are often used inadequately or overlooked, with "statistical significance" often prioritised, frequently obtained through the misuse or misinterpretation of statistical tests. In this study, we reanalyse publicly available image datasets to highlight the crucial role of robust experimental design in interpreting results. Our findings underscore the importance of focusing on effect sizes and biological relevance over arbitrary statistical thresholds. We also discuss the diminishing returns of increased data collection once statistical stability has been achieved. By refining control usage and emphasising effect sizes, this work aims to enhance the reproducibility and robustness of research findings. We provide open-access code to allow researchers to engage with the dataset, promoting better practices in experimental design and data interpretation.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Molecular Biology of the Cell
311 papers in training set
Top 0.2%
12.2%
2
PLOS ONE
5266 papers in training set
Top 17%
11.3%
3
Biology Open
156 papers in training set
Top 0.1%
10.0%
4
Scientific Reports
3612 papers in training set
Top 10%
6.9%
5
Life Science Alliance
285 papers in training set
Top 0.3%
5.6%
6
Journal of Cell Science
393 papers in training set
Top 1%
5.3%
50% of probability mass above
7
Frontiers in Pharmacology
111 papers in training set
Top 0.6%
3.6%
8
MethodsX
16 papers in training set
Top 0.1%
3.3%
9
Current Protocols
15 papers in training set
Top 0.1%
2.8%
10
Nature Protocols
33 papers in training set
Top 0.2%
2.7%
11
eLife
5828 papers in training set
Top 40%
2.4%
12
Bioinformatics
1204 papers in training set
Top 7%
1.8%
13
Journal of Cell Biology
392 papers in training set
Top 3%
1.4%
14
Wellcome Open Research
67 papers in training set
Top 1.0%
1.2%
15
STAR Protocols
18 papers in training set
Top 0.2%
1.2%
16
PLOS Computational Biology
1863 papers in training set
Top 18%
1.1%
17
G3: Genes, Genomes, Genetics
252 papers in training set
Top 4%
1.1%
18
Biological Imaging
15 papers in training set
Top 0.2%
1.1%
19
Frontiers in Cell and Developmental Biology
233 papers in training set
Top 4%
1.0%
20
Biology of the Cell
11 papers in training set
Top 0.1%
1.0%
21
Methods
34 papers in training set
Top 0.6%
0.9%
22
EMBO Reports
263 papers in training set
Top 7%
0.9%
23
iScience
1154 papers in training set
Top 38%
0.6%
24
Frontiers in Bioengineering and Biotechnology
98 papers in training set
Top 3%
0.6%
25
Archives of Toxicology
18 papers in training set
Top 0.3%
0.6%
26
Biophysical Journal
631 papers in training set
Top 5%
0.6%
27
PLOS Biology
486 papers in training set
Top 13%
0.6%
28
European Journal of Cell Biology
15 papers in training set
Top 0.3%
0.6%
29
Science Advances
1243 papers in training set
Top 32%
0.6%
30
Journal of Visualized Experiments
34 papers in training set
Top 0.7%
0.6%