A Quantitative Evaluation of COVID-19 Epidemiological Models
Yogurtcu, O. N.; Rodriguez Messan, M.; Gerkin, R. C.; Belov, A. A.; Yang, H.; Forshee, R. A.; Chow, C. C.
Show abstract
Quantifying how accurate epidemiological models of COVID-19 forecast the number of future cases and deaths can help frame how to incorporate mathematical models to inform public health decisions. Here we analyze and score the predictive ability of publicly available COVID-19 epidemiological models on the COVID-19 Forecast Hub. Our score uses the posted forecast cumulative distributions to compute the log-likelihood for held-out COVID-19 positive cases and deaths. Scores are updated continuously as new data become available, and model performance is tracked over time. We use model scores to construct ensemble models based on past performance. Our publicly available quantitative framework may aid in improving modeling frameworks, and assist policy makers in selecting modeling paradigms to balance the delicate trade-offs between the economy and public health.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Inferring global-scale temporal latent topics from news reports to predict public health interventions for COVID-19 93%
- Hierarchical confounder discovery in the experiment-machine learning cycle 93%
- Single-Cell Multi-Modal GAN (scMMGAN) reveals spatial patterns in single-cell data from triple negative breast cancer 92%
Similar papers in this journal
- Informing pandemic response in the face of uncertainty. An evaluation of the U.S. COVID-19 Scenario Modeling Hub 95%
- Trade-offs between individual and ensemble forecasts of an emerging infectious disease 94%
- An adaptive weight ensemble approach to forecast influenza activity in the context of irregular seasonality 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.