Synergistic Integration Between Machine Learning and Agent-Based Modeling: A Multidisciplinary Review
Open Access
- 2 September 2021
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 34 (5) , 2170-2190
Abstract
Agent-based modeling (ABM) involves developing models in which agents make adaptive decisions in a changing environment. Machine-learning (ML) based inference models can improve sequential decision-making by learning agents' behavioral patterns. With the aid of ML, this emerging area can extend traditional agent-based schemes that hardcode agents' behavioral rules into an adaptive model. Even though there are plenty of studies that apply ML in ABMs, the generalized applicable scenarios, frameworks, and procedures for implementations are not well addressed. In this article, we provide a comprehensive review of applying ML in ABM based on four major scenarios, i.e., microagent-level situational awareness learning, microagent-level behavior intervention, macro-ABM-level emulator, and sequential decision-making. For these four scenarios, the related algorithms, frameworks, procedures of implementations, and multidisciplinary applications are thoroughly investigated. We also discuss how ML can improve prediction in ABMs by trading off the variance and bias and how ML can improve the sequential decision-making of microagent and macrolevel policymakers via a mechanism of reinforced behavioral intervention. At the end of this article, future perspectives of applying ML in ABMs are discussed with respect to data acquisition and quality issues, the possible solution of solving the convergence problem of reinforcement learning, interpretable ML applications, and bounded rationality of ABM.Keywords
Funding Information
- National Science Function (ICER 1830036)
This publication has 145 references indexed in Scilit:
- An Agent-Based Model of Income Inequalities in Diet in the Context of Residential SegregationAmerican Journal of Preventive Medicine, 2011
- Modeling agents based on aspiration adaptation theoryAutonomous Agents and Multi-Agent Systems, 2010
- Urban traffic signal control using reinforcement learning agentsIET Intelligent Transport Systems, 2010
- Agent‐based models in translational systems biologyWIREs Mechanisms of Disease, 2009
- Particle Swarm Optimization Algorithm for Agent-Based Artificial MarketsComputational Economics, 2009
- A standard protocol for describing individual-based and agent-based modelsEcological Modelling, 2006
- Simulating the impact of a molecular ‘decision-process’ on cellular phenotype and multicellular patterns in brain tumorsJournal of Theoretical Biology, 2005
- Ecology in Mare Pentium: an individual-based spatio-temporal model for fish with adapted behaviourFisheries Research, 1998
- Aspiration Adaptation TheoryJournal of Mathematical Psychology, 1998
- The Monte Carlo MethodJournal of the American Statistical Association, 1949