Back

Overcoming challenges of reproducibility and variability for the Clostridioides difficile typification

Bravo-Anton, L.; Guerrero-Lopez, A.; Schmidt-Santiago, L.; Sevilla-Salcedo, C.; Blazquez-Sanchez, M.; Rodriguez-Temporal, D.; Rodriguez-Sanchez, B.; Gomez-Verdejo, V.

2025-01-21 microbiology
10.1101/2024.10.29.620907 bioRxiv
Show abstract

Machine learning (ML) approaches applied to Matrix-Assisted Laser Desorption Ionization-Time of Flight Mass Spectrometry (MALDI-TOF MS) spectra have shown promise for the typing of Clostridioides difficile, yet their deployment in routine clinical settings remains challenging due to strong sensitivity to acquisition variability. Differences in culture media, incubation time, protein extraction protocols, and instrumentation across hospitals often lead to substantial performance degradation when models are evaluated under heterogeneous or previously unseen conditions. In this work, we systematically analyze the impact of methodological and technical variability on ML-based C. difficile typing and investigate whether data augmentation (DA) strategies can mitigate these effects. Using a dedicated dataset of 60 isolates acquired under diverse conditions, we show that DA substantially improves robustness to variability when training on spectra from selective C. difficile agar media. Importantly, models trained with DA achieve performance levels approaching those obtained using enriched Schaedler agar media, while relying exclusively on standard 24-hour incubation. Evaluation on an independent cohort of 28 newly acquired isolates confirms that DA significantly reduces performance degradation under real-world domain shift. To facilitate adoption and reproducibility, we release MAL-DIDA, an open-source Python library for DA of MALDI-TOF MS spectra.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

1
PLOS ONE
5266 papers in training set
Top 9%
19.0%
2
Analytical and Bioanalytical Chemistry
18 papers in training set
Top 0.1%
9.9%
3
Talanta
14 papers in training set
Top 0.1%
5.6%
4
Journal of the American Society for Mass Spectrometry
37 papers in training set
Top 0.1%
4.5%
5
Journal of Proteome Research
234 papers in training set
Top 0.7%
4.2%
6
Molecules
39 papers in training set
Top 0.2%
3.5%
7
Scientific Reports
3612 papers in training set
Top 31%
3.3%
50% of probability mass above
8
Analytical Chemistry
218 papers in training set
Top 1%
3.2%
9
The Analyst
16 papers in training set
Top 0.1%
2.0%
10
Bioinformatics
1204 papers in training set
Top 7%
1.8%
11
Biomedicines
67 papers in training set
Top 0.9%
1.8%
12
Journal of Clinical Microbiology
130 papers in training set
Top 0.8%
1.8%
13
Metabolites
53 papers in training set
Top 0.5%
1.7%
14
Analytical Biochemistry
26 papers in training set
Top 0.2%
1.5%
15
International Journal of Molecular Sciences
494 papers in training set
Top 9%
1.5%
16
Frontiers in Microbiology
427 papers in training set
Top 6%
1.4%
17
Microbiology Spectrum
469 papers in training set
Top 8%
1.4%
18
Journal of Microbiological Methods
13 papers in training set
Top 0.3%
1.2%
19
Frontiers in Bioinformatics
49 papers in training set
Top 0.7%
1.2%
20
Molecular & Cellular Proteomics
158 papers in training set
Top 1%
1.2%
21
Biomedical Optics Express
95 papers in training set
Top 0.7%
1.2%
22
Forensic Science International: Genetics
26 papers in training set
Top 0.1%
1.1%
23
BMC Microbiology
49 papers in training set
Top 1%
1.1%
24
Biology Methods and Protocols
61 papers in training set
Top 2%
1.0%
25
PLOS Neglected Tropical Diseases
466 papers in training set
Top 5%
1.0%
26
Methods
34 papers in training set
Top 0.6%
0.9%
27
Cancers
213 papers in training set
Top 4%
0.9%
28
Sensors
43 papers in training set
Top 1%
0.6%
29
Computational and Structural Biotechnology Journal
242 papers in training set
Top 7%
0.6%
30
Diagnostics
50 papers in training set
Top 3%
0.6%