Evaluation of FluSight influenza forecasting in the 2021-22 and 2022-23 seasons with a new target laboratory-confirmed influenza hospitalizations
Mathis, S. M.; Webber, A. E.; Basu, A.; Drake, J. M.; White, L. A.; Murray, E. L.; Sun, M.; Leon, T. M.; Hu, A. J.; Shemetov, D.; Brooks, L. C.; Tibshirani, R. J.; Green, A.; McDonald, D. J.; Rosenfeld, R.; Kandula, S.; Yamana, T. K.; Pei, S.; Yaari, R.; Shaman, J.; Meiyappan, A.; Omar, S.; Prakash, B. A.; Rodriguez, A.; Kamarthi, H.; Gururajan, G.; Agarwal, P.; Zhao, Z.; Balusu, S.; Raman, R.; Thommes, E. W.; Cojocaru, M. G.; Suchoski, B. T.; Stage, S. A.; Gurung, H. L.; Baccam, P.; Ajelli, M.; Ventura, P. C.; Litvinova, M.; Kummer, A. G.; Wadsworth, S.; Niemi, J.; Carcelen, E.; Hill, A. L.;
Show abstract
Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. Forecasting teams were asked to provide national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one through four weeks ahead for the 2021-22 and 2022-23 influenza seasons. Across both seasons, 26 teams submitted forecasts, with the submitting teams varying between seasons. Forecast skill was evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage. Six out of 23 models outperformed the baseline model across forecast weeks and locations in 2021-22 and 12 out of 18 models in 2022-23. Averaging across all forecast targets, the FluSight ensemble was the 2nd most accurate model measured by WIS in 2021-22 and the 5th most accurate in the 2022-23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degraded over longer forecast horizons and during periods of rapid change. Current influenza forecasting efforts help inform situational awareness, but research is needed to address limitations, including decreased performance during periods of changing epidemic dynamics.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- A Stacked ensemble method for forecasting influenza-like illness visit volumes at emergency departments 96%
- Early Detection of COVID-19 Outbreaks Using Human Mobility Data 93%
- Using mobile phone data to estimate dynamic population changes and improve the understanding of a pandemic: A case study in Andorra 92%
Similar papers in this journal
- A prospective real-time transfer learning approach to estimate Influenza hospitalizations with limited data 97%
- Assessing the utility of COVID-19 case reports as a leading indicator for hospitalization forecasting in the United States 96%
- Globally Local: Hyper-local Modeling for Accurate Forecast of COVID-19 93%
Similar papers in this journal
- Detection of novel influenza viruses through community and healthcare testing: Implications for surveillance efforts in the United States 93%
- Interactions among common non-SARS-CoV-2 respiratory viruses and influence of the COVID-19 pandemic on their circulation in New York City 93%
- Biases in routine influenza surveillance indicators used to monitor infection incidence and recommendations for improvement 93%
Similar papers in this journal
- A dynamic ensemble model for short-term forecasting in pandemic situations 94%
- Modeling robust COVID-19 intensive care unit occupancy thresholds for imposing mitigation to prevent exceeding capacities 92%
- Measuring the impact of nonpharmaceutical interventions on the SARS-CoV-2 pandemic at a city level: An agent-based computational modeling study of the City of Natal 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.