Moving the needle: Employing deep reinforcement learning to push the boundaries of coarse-grained vaccine models
Open Access
- 3 November 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Immunology
- Vol. 13, 1029167
Abstract
Highly mutable infectious disease pathogens (hm-IDPs) such as HIV and influenza evolve faster than the human immune system can contain them, allowing them to circumvent traditional vaccination approaches and causing over one million deaths annually. Agent-based models can be used to simulate the complex interactions that occur between immune cells and hm-IDP-like proteins (antigens) during affinity maturation—the process by which antibodies evolve. Compared to existing experimental approaches, agent-based models offer a safe, low-cost, and rapid route to study the immune response to vaccines spanning a wide range of design variables. However, the highly stochastic nature of affinity maturation and vast sequence space of hm-IDPs render brute force searches intractable for exploring all pertinent vaccine design variables and the subset of immunization protocols encompassed therein. To address this challenge, we employed deep reinforcement learning to drive a recently developed agent-based model of affinity maturation to focus sampling on immunization protocols with greater potential to improve the chosen metrics of protection, namely the broadly neutralizing antibody (bnAb) titers or fraction of bnAbs produced. Using this approach, we were able to coarse-grain a wide range of vaccine design variables and explore the relevant design space. Our work offers new testable insights into how vaccines should be formulated to maximize protective immune responses to hm-IDPs and how they can be minimally tailored to account for major sources of heterogeneity in human immune responses and various socioeconomic factors. Our results indicate that the first 3 to 5 immunizations, depending on the metric of protection, should be specially tailored to achieve a robust protective immune response, but that beyond this point further immunizations require only subtle changes in formulation to sustain a durable bnAb response.Keywords
This publication has 75 references indexed in Scilit:
- Viral Escape from HIV-1 Neutralizing Antibodies Drives Increased Plasma Neutralization Breadth through Sequential Recognition of Multiple Epitopes and ImmunotypesPLOS Pathogens, 2013
- SKEMPI: a Structural Kinetic and Energetic database of Mutant Protein Interactions and its use in empirical modelsBioinformatics, 2012
- Germinal center selection and the development of memory B and plasma cellsImmunological Reviews, 2012
- Age Affects Quantity but Not Quality of Antibody Responses after Vaccination with an Inactivated Flavivirus Vaccine against Tick-Borne EncephalitisPLOS ONE, 2012
- Broad neutralization coverage of HIV by multiple highly potent antibodiesNature, 2011
- Broadly neutralizing human antibody that recognizes the receptor-binding pocket of influenza virus hemagglutininProceedings of the National Academy of Sciences, 2011
- Sequential Immunization with a Subtype B HIV-1 Envelope Quasispecies Partially Mimics the In Vivo Development of Neutralizing AntibodiesJournal of Virology, 2011
- Germinal Center Dynamics Revealed by Multiphoton Microscopy with a Photoactivatable Fluorescent ReporterCell, 2010
- Optimality of Mutation and Selection in Germinal CentersPLOS Computational Biology, 2010
- Multifunctional TH1 cells define a correlate of vaccine-mediated protection against Leishmania majorNature Medicine, 2007