Nowcasting to Monitor Real-Time Mpox Trends During the 2022 Outbreak in New York City: An Evaluation Using Reportable Disease Data Stratified by Race or Ethnicity (Preprint)
Preprint
- 31 January 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Applying nowcasting methods to partially accrued reportable disease data can help policymakers interpret recent epidemic trends and quickly identify and remediate health inequities. During the 2022 mpox outbreak in New York City (NYC), we applied Nowcasting by Bayesian Smoothing (NobBS) to estimate recent cases, citywide and stratified by race or ethnicity. However, in real time, it was unclear if estimates were accurate. OBJECTIVE We evaluated the accuracy of estimated mpox case counts across a range of NobBS implementation options. METHODS We evaluated NobBS performance for NYC residents with confirmed or probable mpox diagnosis or illness onset from July 8 through September 30, 2022, as compared with fully accrued cases. We used the mean absolute error (MAE), relative root mean square error (rRMSE), and 95% prediction interval (PI) coverage to compare moving window lengths, stratifying or not by race or ethnicity, diagnosis and onset time elements, and daily and weekly time units. RESULTS During the study period, 3305 NYC residents were diagnosed with mpox (median 4 days from diagnosis to diagnosis report), and 2278 patients had known illness onset (median 10 days from onset to onset report). No single moving window length performed best. As window lengths increased from 14 to 49 days, generally, MAE improved (decreased), while rRMSE worsened (increased). For the diagnosis time element, for the 14-day moving window used in real time, MAE was 9, rRMSE was 0.23, and 95% PI coverage was 96%; ranges for longer moving windows were MAE: 3–9, rRMSE: 0.25–0.30, and 95% PI coverage: 93%–100%. For the onset time element, for the 21-day moving window used in real time, MAE was 12, rRMSE was 1.07, and 95% PI coverage was 84%; ranges for other moving windows were MAE: 7–11, rRMSE: 0.75–1.42, and 95% PI coverage: 75%–99%. For any given moving window length, rRMSE worsened (increased) for stratified compared with unstratified estimates. For stratified daily diagnosis hindcasts, for the 14-day moving window used in real time, rRMSE was 0.32, and 95% PI coverage was 95%; ranges for other moving window lengths were rRMSE: 0.35–0.50 and 95% PI coverage: 96%–100%. Performance generally worsened when using onset compared with diagnosis time elements and weekly compared with daily time units. Hindcasts underestimated diagnoses in early August after the epidemic peaked, then overestimated diagnoses in late August during epidemic waning. Estimates were most accurate during September, when cases were low and stable. CONCLUSIONS For nowcasting this outbreak using NobBS, accuracy depended on the moving window length and whether cases were stratified. Health departments need additional nowcasting guidance, particularly to promote health equity by ensuring stratified estimates are accurate and to improve robustness, such as by incorporating multiple methods.Keywords
This publication has 14 references indexed in Scilit:
- Nowcasting and Forecasting the 2022 U.S. Mpox Outbreak: Support for Public Health Decision Making and Lessons LearnedmedRxiv, 2023
- Mpox in the New York metropolitan area, Summer 2022Journal of Medical Virology, 2023
- Real-time forecasting the trajectory of monkeypox outbreaks at the national and global levels, July–October 2022BMC Medicine, 2023
- Epidemiologic and Clinical Features of Mpox in Transgender and Gender-Diverse Adults — United States, May–November 2022MMWR. Morbidity and Mortality Weekly Report, 2022
- Knowing the unknown: The underestimation of monkeypox cases. Insights and implications from an integrative review of the literatureFrontiers in Microbiology, 2022
- Nowcasting for Real-Time COVID-19 Tracking in New York City: An Evaluation Using Reportable Disease Data From Early in the PandemicJMIR Public Health and Surveillance, 2021
- Nowcasting by Bayesian Smoothing: A flexible, generalizable model for real-time epidemic trackingPLOS Computational Biology, 2020
- The Role of Stigma and Medical Mistrust in the Routine Health Care Engagement of Black Men Who Have Sex With MenAmerican Journal of Public Health, 2015
- Addressing Stigma and Discrimination Through Participatory Media Planning2010
- Measuring sexual behaviour: methodological challenges in survey researchSexually Transmitted Infections, 2001