Evaluation of FluSight influenza forecasting in the 2021-22 and 2022-23 seasons with a new target laboratory-confirmed influenza hospitalizations
Authors:
Preprint
Abstract
Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. Forecasting teams were asked to provide national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one through four weeks ahead for the 2021-22 and 2022-23 influenza seasons. Across both seasons, 26 teams submitted forecasts, with the submitting teams varying between seasons. Forecast skill was evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage. Six out of 23 models outperformed the baseline model across forecast weeks and locations in 2021-22 and 12 out of 18 models in 2022-23. Averaging across all forecast targets, the FluSight ensemble was the 2 nd most accurate model measured by WIS in 2021-22 and the 5 th most accurate in the 2022-23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degraded over longer forecast horizons and during periods of rapid change. Current influenza forecasting efforts help inform situational awareness, but research is needed to address limitations, including decreased performance during periods of changing epidemic dynamics.Keywords
This publication has 15 references indexed in Scilit:
- Phase-Informed Bayesian Ensemble Models Improve Performance of COVID-19 ForecastsProceedings of the AAAI Conference on Artificial Intelligence, 2023
- Influenza Activity and Composition of the 2022–23 Influenza Vaccine — United States, 2021–22 SeasonMMWR. Morbidity and Mortality Weekly Report, 2022
- Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the United StatesProceedings of the National Academy of Sciences, 2022
- Real-time pandemic surveillance using hospital admissions and mobility dataProceedings of the National Academy of Sciences, 2022
- Improving Pandemic Response: Employing Mathematical Modeling to Confront Coronavirus Disease 2019Clinical Infectious Diseases, 2021
- Changes in Influenza and Other Respiratory Virus Activity During the COVID-19 Pandemic — United States, 2020–2021MMWR. Morbidity and Mortality Weekly Report, 2021
- Applying infectious disease forecasting to public health: a path forward using influenza forecasting examplesBMC Public Health, 2019
- Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the U.S.PLOS Computational Biology, 2019
- Collaborative efforts to forecast seasonal influenza in the United States, 2015–2016Scientific Reports, 2019
- A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United StatesProceedings of the National Academy of Sciences, 2019