Reinforcement Learning with Neural Networks for Quantum Feedback
Authors:
Top Cited Papers
Open Access
- 27 September 2018
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review X
- Vol. 8 (3) , 031084
Abstract
Machine learning with artificial neural networks is revolutionizing science. The most advanced challenges require discovering answers autonomously. In the domain of reinforcement learning, control strategies are improved according to a reward function. The power of neural-network-based reinforcement learning has been highlighted by spectacular recent successes such as playing Go, but its benefits for physics are yet to be demonstrated. Here, we show how a network-based “agent” can discover complete quantum-error-correction strategies, protecting a collection of qubits against noise. These strategies require feedback adapted to measurement outcomes. Finding them from scratch without human guidance and tailored to different hardware resources is a formidable challenge due to the combinatorially large search space. To solve this challenge, we develop two ideas: two-stage learning with teacher and student networks and a reward quantifying the capability to recover the quantum information stored in a multiqubit system. Beyond its immediate impact on quantum computation, our work more generally demonstrates the promise of neural-network-based reinforcement learning in physics.Keywords
All Related Versions
This publication has 48 references indexed in Scilit:
- Persistent Control of a Superconducting Qubit by Stroboscopic Measurement FeedbackPhysical Review X, 2013
- The Automation of ScienceScience, 2009
- Distilling Free-Form Natural Laws from Experimental DataScience, 2009
- Cavity grid for scalable quantum computation with superconducting circuitsEurophysics Letters, 2009
- Natural Actor-CriticNeurocomputing, 2008
- Optimal control of coupled spin dynamics: design of NMR pulse sequences by gradient ascent algorithmsJournal of Magnetic Resonance, 2005
- Realization of quantum error correctionNature, 2004
- Long Short-Term MemoryNeural Computation, 1997
- Scheme for reducing decoherence in quantum computer memoryPhysical Review A, 1995
- Function Optimization using Connectionist Reinforcement Learning AlgorithmsConnection Science, 1991