A Two-Timescale Stochastic Algorithm Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic
Authors:
Top Cited Papers
- 27 January 2023
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 33 (1) , 147-180
Abstract
This paper analyzes a two-timescale stochastic algorithm framework for bilevel optimization. Bilevel optimization is a class of problems which exhibits a two-level structure, and its goal...Keywords
All Related Versions
Funding Information
- National Science Foundation (CIF-1910385, CMMI-1727757)
This publication has 25 references indexed in Scilit:
- Natural Actor-CriticNeurocomputing, 2008
- An overview of bilevel optimizationAnnals of Operations Research, 2007
- Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithmsThe Annals of Applied Probability, 2006
- Convergence rate of linear two-time-scale stochastic approximationThe Annals of Applied Probability, 2004
- Stochastic approximation with two time scalesSystems & Control Letters, 1997
- On bilevel programming, Part I: General nonlinear casesMathematical Programming, 1995
- Descent approaches for quadratic bilevel programmingJournal of Optimization Theory and Applications, 1994
- A penalty function approach for solving bi-level linear programsJournal of Global Optimization, 1993
- Double penalty method for bilevel optimization problemsAnnals of Operations Research, 1992
- Learning to predict by the methods of temporal differencesMachine Learning, 1988