Multi-season evaluation and analysis of categorical trend forecasts of influenza hospital admissions in the United States
Davis, J. T.; Kaur, G.; Hines, A.; Ben-Nun, M.; Venkatramanan, S.; Brooks, L.; Mathis, S.; Ajelli, M.; Litvinova, M.; Kummer, A. G.; Ventura, P. C.; Mhade, S.; Weber, D.; Shemetov, D.; DeFries, N.; McDonald, D. J.; Yamana, T.; Zepeda-Tello, R.; Shaman, J.; Yaari, R.; Pei, S.; Webber, A.; Shandross, L.; Ray, E.; Wadsworth, S.; Niemi, J.; Redman, W. T.; Mullany, L.; Posner, R.; Mallela, A.; Lin, Y. T.; Hlavacek, W. S.; Smart, A.; Gill, A. A.; Drennan, A.; Fiebiger, B. J.; Miller, E. F.; Lee, J.; Mihaljevic, J. R.; Geist, K. A.; Baltz, M.; Bernik, O.; Truong, Y.-M. B.; Chen, Y.; Grosvenor, C. J.;
Show abstract
Forecasting influenza hospitalizations informs public health preparedness, yet questions remain about which types of forecasts best guide action. We evaluate categorical trend forecasts, which communicate probabilities of upcoming increases or decreases in epidemic trajectories, submitted to CDC's FluSight Forecasting Challenge between Fall-2024 and Spring-2026. Teams submitted probability distributions over five categories describing direction and magnitude of week-over-week changes in laboratory-confirmed influenza hospital admissions. We assessed performance using Ranked Probability Skill Score, Brier Skill Score, and measures of forecast-observation agreement. Most models outperformed an equal-probability baseline; the FluSight ensemble ranked among the top three in the 2024-25 and 2025-26 seasons. Forecasts were most accurate during stable periods and least during periods of rapid change, with most models underestimating observed trends. Conclusions were robust to choice of scoring metric and reference model. These results support categorical trend ensembles as an approach to communicating infectious disease forecasts that may inform public health decision-making.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Foundation time series models for forecasting and policy evaluation in infectious disease epidemics 95%
- A prospective real-time transfer learning approach to estimate Influenza hospitalizations with limited data 94%
- Assessing the utility of COVID-19 case reports as a leading indicator for hospitalization forecasting in the United States 94%
Similar papers in this journal
- Infectious disease modeling for public health practice: projections, scenarios, and uncertainty in three phases of outbreak response 94%
- A quantitative framework to define the end of an outbreak: application to Ebola Virus Disease 93%
- Using LASSO regression to estimate the population-level impact of pneumococcal conjugate vaccines 91%
Similar papers in this journal
- Fine-Grained Forecasting of COVID-19 Trends at the County Level in the United States 92%
- Predicting critical state after COVID-19 diagnosis: Model development using a large US electronic health record dataset 92%
- It’s complicated: characterizing the time-varying relationship between cell phone mobility and COVID-19 spread in the US 91%
Similar papers in this journal
- Early Detection of COVID-19 Outbreaks Using Human Mobility Data 94%
- A Stacked ensemble method for forecasting influenza-like illness visit volumes at emergency departments 93%
- A Bayesian Susceptible-Infectious-Hospitalized-Ventilated-Recovered Model to Predict Demand for COVID-19 Inpatient Care in a Large Healthcare System 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.