Back

Enhancing Early Warning Outbreak Detection Using Multi Model Stacking Ensemble

Oliveira, J. F.; Alencar, A. L.; Coutinho, E. R.; Borges, D. G. F.; Filho, F. M. H. S.; Santos-Silva, R.; Tavares Veras Florentino, P.; Cunha, M. C. S. L.; Marcilio, I.; Pereira Ramos, P. I.; Andrade, R. F. S.; Barral-Netto, M.

2026-07-13 health systems and quality improvement
10.64898/2026.07.09.26357658 medRxiv
Show abstract

Background: Evaluating outbreak detection models is a key component of syndromic surveillance. However, balancing timeliness, predictive performance, and local surveillance constraints remains a major challenge. We developed and assessed whether stacking ensemble approaches, which integrate multiple outbreak detection methods, can improve the timeliness and predictive performance of influenza-like illness (ILI) surge detection. Methods: We developed a two-stage stacking ensemble framework to detect early warning of ILI surges in city-level Primary Health Care encounter time series from Brazil (2022 to 2025). Epidemic thresholds were defined using the Moving Epidemic Method (MEM). In the first stage, multiple outbreak detection models (ODMs) generated warnings of unusual ILI activity. In the second, these warnings were then used as inputs to three supervised meta-classifiers: Logistic Regression, Extreme Gradient Boosting (XGB), and a Multi-layer Perceptron (MLP). For comparison, a Majority Voting (MV) aggregation is also examined. Timeliness, sensitivity, specificity, positive and negative predictive values are evaluated to measure each model's ability to anticipate epidemic periods of varying intensity in 2025. Robustness was further assessed using simulated outbreak scenarios with varying magnitudes and durations. Findings: We identified 5,765 ILI surge onsets across 5,365 Brazilian municipalities in 2025. Compared with individual ODMs and MV, stacking ensemble meta-classifiers anticipated up to 33% of surge onsets three weeks in advance (an average improvement of 15 percentage points) while reducing missed detections to <10%. They achieved sensitivity >90%, while maintaining balanced specificity >80%, PPV >65%, and NPV >99%. Improvements were greatest for very high-intensity surges, with missed detections reduced by more than half compared with individual ODMs. In simulated outbreak scenarios, the MLP and XGB classifiers remained robust despite being trained on fewer than half of all simulated surge events, consistently outperforming individual detection methods and simpler integration approaches. Interpretation: We provide a practical framework for integrating complementary ODMs into a single, robust early warning decision. By improving both timeliness and predictive performance without requiring additional surveillance data or resources, this approach offers a scalable methodological upgrade for syndromic surveillance systems and supports more reliable public health decision-making. Funding: The Rockefeller Foundation (award 2023 PPI 007 to MB-N); Brazilian National Research Council - CNPq (408775/2024-6); MB-N, PIPR, RFSA are CNPq fellows.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

1
PLOS Global Public Health
344 papers in training set
Top 1%
15.0%
2
BMC Medical Research Methodology
47 papers in training set
Top 0.1%
11.9%
3
PLOS ONE
5266 papers in training set
Top 22%
7.8%
4
Communications Medicine
113 papers in training set
Top 0.4%
5.5%
5
Epidemics
116 papers in training set
Top 0.5%
5.1%
6
Scientific Reports
3612 papers in training set
Top 27%
4.0%
7
Sensors
43 papers in training set
Top 0.4%
3.2%
50% of probability mass above
8
Frontiers in Public Health
148 papers in training set
Top 2%
3.2%
9
Frontiers in Digital Health
24 papers in training set
Top 0.5%
2.8%
10
The Lancet Regional Health - Americas
22 papers in training set
Top 0.1%
2.8%
11
International Journal of Infectious Diseases
129 papers in training set
Top 0.9%
2.4%
12
BMJ Global Health
113 papers in training set
Top 2%
2.1%
13
The American Journal of Tropical Medicine and Hygiene
68 papers in training set
Top 0.8%
2.1%
14
PLOS Digital Health
106 papers in training set
Top 2%
1.9%
15
International Journal of Environmental Research and Public Health
128 papers in training set
Top 3%
1.7%
16
Environment International
43 papers in training set
Top 0.5%
1.4%
17
PLOS Neglected Tropical Diseases
466 papers in training set
Top 4%
1.3%
18
BMC Medicine
176 papers in training set
Top 4%
1.1%
19
Nature Communications
5641 papers in training set
Top 51%
1.1%
20
BMC Health Services Research
51 papers in training set
Top 2%
1.1%
21
One Health
29 papers in training set
Top 0.4%
1.1%
22
Science of The Total Environment
186 papers in training set
Top 3%
1.0%
23
eClinicalMedicine
77 papers in training set
Top 2%
1.0%
24
Journal of Medical Internet Research
87 papers in training set
Top 3%
0.8%
25
Infectious Disease Modelling
54 papers in training set
Top 1%
0.8%
26
Frontiers in Pediatrics
32 papers in training set
Top 1%
0.8%
27
BMC Public Health
158 papers in training set
Top 5%
0.8%
28
BMJ Open
601 papers in training set
Top 13%
0.8%
29
Public Health
36 papers in training set
Top 0.9%
0.8%
30
Tropical Medicine & International Health
14 papers in training set
Top 0.9%
0.6%