Is multiagent deep reinforcement learning the answer or the question? A brief survey
Authors:
- Pablo Hernandez-LealPHPablo Hernandez-Leal
- Bilal KartalBKBilal Kartal
- Matthew E. TaylorMTMatthew E. Taylor
Preprint
Abstract
Deep reinforcement learning (DRL) has achieved outstanding results in recent years. This has led to a dramatic increase in the number of applications and methods. Recent works have explored learning beyond single-agent scenarios and have considered multiagent scenarios. Initial results report successes in complex multiagent domains, although there are several challenges to be addressed. In this context, first, this article provides a clear overview of current multiagent deep reinforcement learning (MDRL) literature. Second, it provides guidelines to complement this emerging area by (i) showcasing examples on how methods and algorithms from DRL and multiagent learning (MAL) have helped solve problems in MDRL and (ii) providing general lessons learned from these works. We expect this article will help unify and motivate future research to take advantage of the abundant literature that exists in both areas (DRL and MAL) in a joint effort to promote fruitful research in the multiagent community.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Cooperative Multi-agent Policy Gradient2019
- Weighted Double Deep Multiagent Reinforcement Learning in Stochastic Cooperative Environments2018
- Efficiently detecting switches against non-stationary opponentsAutonomous Agents and Multi-Agent Systems, 2016
- Bayesian policy reuseMachine Learning, 2016
- A Concise Introduction to Decentralized POMDPs2016
- How much does it help to know what she knows you know? An agent-based simulation studyArtificial Intelligence, 2013
- If multi-agent learning is the answer, what is the question?Artificial Intelligence, 2007
- Multiagent learning is not the answer. It is the questionArtificial Intelligence, 2007
- AWESOME: A general multiagent learning algorithm that converges in self-play and learns a best response against stationary opponentsMachine Learning, 2006
- Cooperative Multi-Agent Learning: The State of the ArtAutonomous Agents and Multi-Agent Systems, 2005