Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Design
Authors:
- 1 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1332-1335
Abstract
In recent years, quantum computing (QC) has been getting a lot of attention from industry and academia. Especially, among various QC research topics, variational quantum circuit (VQC) enables quantum deep reinforcement learning (QRL). Many studies of QRL have shown that the QRL is superior to the classical reinforcement learning (RL) methods under the constraints of the number of training parameters. This paper extends and demonstrates the QRL to quantum multi-agent RL (QMARL). However, the extension of QRL to QMARL is not straightforward due to the challenge of the noise intermediate-scale quantum (NISQ) and the non-stationary properties in classical multi-agent RL (MARL). Therefore, this paper proposes the centralized training and decentralized execution (CTDE) QMARL framework by designing novel VQCs for the framework to cope with these issues. To corroborate the QMARL framework, this paper conducts the QMARL demonstration in a single-hop environment where edge agents offload packets to clouds. The extensive demonstration shows that the proposed QMARL framework enhances 57.7% of total reward than classical frameworks.Keywords
All Related Versions
Funding Information
- National Research Foundation
This publication has 11 references indexed in Scilit:
- QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits2022
- Introduction to Quantum Reinforcement Learning: Theory and PennyLane-based Implementation2021
- Quantum Neural Networks: Concepts, Applications, and Challenges2021
- Quantum Convolutional Neural Network on Protein Distance Prediction2021
- Universal variational quantum computationPhysical Review A, 2021
- Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and ApplicationsProceedings of the IEEE, 2021
- A Tutorial on Quantum Convolutional Neural Networks (QCNN)2020
- Variational Quantum Circuits for Deep Reinforcement LearningIEEE Access, 2020
- Machine learning and the physical sciencesReviews of Modern Physics, 2019
- Scheme for reducing decoherence in quantum computer memoryPhysical Review A, 1995