A simple linear algebra identity to optimize large-scale neural network quantum states
Top Cited Papers
Open Access
- 2 August 2024
- journal article
- research article
- Published by Springer Nature in Communications Physics
- Vol. 7 (1) , 1-8
Abstract
Neural-network architectures have been increasingly used to represent quantum many-body wave functions. These networks require a large number of variational parameters and are challenging to optimize using traditional methods, as gradient descent. Stochastic reconfiguration (SR) has been effective with a limited number of parameters, but becomes impractical beyond a few thousand parameters. Here, we leverage a simple linear algebra identity to show that SR can be employed even in the deep learning scenario. We demonstrate the effectiveness of our method by optimizing a Deep Transformer architecture with 3 × 105parameters, achieving state-of-the-art ground-state energy in theJ1–J2Heisenberg model atJ2/J1 = 0.5 on the 10 × 10 square lattice, a challenging benchmark in highly-frustrated magnetism. This work marks a significant step forward in the scalability and efficiency of SR for neural-network quantum states, making them a promising method to investigate unknown quantum phases of matter, where other methods struggle.Keywords
All Related Versions
This publication has 49 references indexed in Scilit:
- Empowering deep neural quantum states through efficient optimizationNature Physics, 2024
- Variational Monte Carlo with large patched transformersCommunications Physics, 2024
- Boltzmann machines and quantum many-body problemsJournal of Physics: Condensed Matter, 2023
- Deep learning representations for quantum many-body systems on heterogeneous hardwareMachine Learning: Science and Technology, 2023
- Data-driven emergence of convolutional structure in neural networksProceedings of the National Academy of Sciences, 2022
- Helping restricted Boltzmann machines with quantum-state representation by restoring symmetryJournal of Physics: Condensed Matter, 2021
- Hybrid convolutional neural network and projected entangled pair states wave functions for quantum many-particle statesPhysical Review B, 2021
- Neural Gutzwiller-projected variational wave functionsPhysical Review B, 2019
- Two-dimensional frustrated model studied with neural network quantum statesPhysical Review B, 2019
- Quantum Monte Carlo Approaches for Correlated Systems2017