Efficient and targeted COVID-19 border testing via reinforcement learning
- 22 September 2021
- journal article
- research article
- Published by Springer Nature in Nature
- Vol. 599 (7883) , 108-113
Abstract
Throughout the coronavirus disease 2019 (COVID-19) pandemic, countries have relied on a variety of ad hoc border control protocols to allow for non-essential travel while safeguarding public health, from quarantining all travellers to restricting entry from select nations on the basis of population-level epidemiological metrics such as cases, deaths or testing positivity rates1,2. Here we report the design and performance of a reinforcement learning system, nicknamed Eva. In the summer of 2020, Eva was deployed across all Greek borders to limit the influx of asymptomatic travellers infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and to inform border policies through real-time estimates of COVID-19 prevalence. In contrast to country-wide protocols, Eva allocated Greece’s limited testing resources on the basis of incoming travellers’ demographic information and testing results from previous travellers. By comparing Eva’s performance against modelled counterfactual scenarios, we show that Eva identified 1.85 times as many asymptomatic, infected travellers as random surveillance testing, with up to 2–4 times as many during peak travel, and 1.25–1.45 times as many asymptomatic, infected travellers as testing policies that utilize only epidemiological metrics. We demonstrate that this latter benefit arises, at least partially, because population-level epidemiological metrics had limited predictive value for the actual prevalence of SARS-CoV-2 among asymptomatic travellers and exhibited strong country-specific idiosyncrasies in the summer of 2020. Our results raise serious concerns on the effectiveness of country-agnostic internationally proposed border control policies3 that are based on population-level epidemiological metrics. Instead, our work represents a successful example of the potential of reinforcement learning and real-time data for safeguarding public health.Keywords
This publication has 21 references indexed in Scilit:
- A gendered human rights analysis of Ebola and Zika: locating gender in global health emergenciesInternational Affairs, 2016
- Batched bandit problemsThe Annals of Statistics, 2016
- Bandits with concave rewards and convex knapsacks2014
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Empirical Bayes Methods for Stabilizing Incidence Rates before MappingEpidemiology, 1994
- Empirical-Bayes Adjustments for Multiple Comparisons Are Sometimes UsefulEpidemiology, 1991
- Asymptotically efficient adaptive allocation rulesAdvances in Applied Mathematics, 1985
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- The Detection of Defective Members of Large PopulationsThe Annals of Mathematical Statistics, 1943
- ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLESBiometrika, 1933