Reinforcement Learning with Neural Networks for Quantum Feedback
Authors:
- Thomas FöselTFThomas Fösel
- Petru TighineanuPTPetru Tighineanu
- Talitha WeissTWTalitha Weiss
- Florian MarquardtFMFlorian Marquardt
Preprint
Abstract
Artificial neural networks are revolutionizing science. While the most prevalent technique involves supervised training on queries with a known correct answer, more advanced challenges often require discovering answers autonomously. In reinforcement learning, control strategies are improved according to a reward function. The power of this approach has been highlighted by spectactular recent successes, such as playing Go. So far, it has remained an open question whether neural-network-based reinforcement learning can be successfully applied in physics. Here, we show how to use this method for finding quantum feedback schemes, where a network-based "agent" interacts with and occasionally decides to measure a quantum system. We illustrate the utility by finding gate sequences that preserve the quantum information stored in a small collection of qubits against noise. This specific application will help to find hardware-adapted feedback schemes for small quantum modules while demonstrating more generally the promise of neural-network based reinforcement learning in physics.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Demonstration of a small programmable quantum computer with atomic qubitsNature, 2016
- Extending the lifetime of a quantum bit with error correction in superconducting circuitsNature, 2016
- A two-qubit logic gate in siliconNature, 2015
- Deep learningNature, 2015
- State preservation by repetitive error detection in a superconducting quantum circuitNature, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Quantum error correction in a solid-state hybrid spin registerNature, 2014
- Optimal control of coupled spin dynamics: design of NMR pulse sequences by gradient ascent algorithmsJournal of Magnetic Resonance, 2005
- Realization of quantum error correctionNature, 2004
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992