Application-Driven Learning: A Closed-Loop Prediction and Optimization Approach Applied to Dynamic Reserves and Demand Forecasting
- 1 January 2025
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Operations Research
- Vol. 73 (1) , 22-39
Abstract
Application-Driven Learning: Closing the Loop Between the Application and the Estimation of Forecast Models This paper introduces a closed-loop framework called application-driven learning, where the best forecast model is tailored to the application cost structure. Our methodology employs two-stage optimization schemes to derive multivariate point forecasts. The estimation problem is conceived as a bilevel model, and we propose two solution methodologies: an exact one using KKT conditions and a scalable decomposition heuristic. This approach offers a scientifically grounded alternative to ad hoc demand biasing approaches and reserve requirement rules currently adopted by power system operators worldwide. Testing with real data and large-scale systems demonstrates that our methodology consistently outperforms traditional open-loop methods, providing significant potential benefits for energy system operations.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Distribution-free algorithms for predictive stochastic programming in the presence of streaming dataComputational Optimization and Applications, 2023
- JuMP 1.0: recent improvements to a modeling language for mathematical optimizationMathematical Programming Computation, 2023
- A bilevel framework for decision-making under uncertainty with contextual informationOmega, 2022
- Dynamic dimensioning approach for operating reserves: Proof of concept in BelgiumEnergy Policy, 2019
- A flexible ramping product: Can it help real-time dispatch markets approach the stochastic dispatch ideal?Electric Power Systems Research, 2014
- An SOS1-Based Approach for Solving MPECs with a Natural Gas Market ApplicationNetworks and Spatial Economics, 2012
- Impact of wind generation on the operation and development of the UK electricity systemsElectric Power Systems Research, 2007
- A Consistent Test of Stationary-ErgodicityEconometric Theory, 1993
- On the ε-perturbation method for avoiding degeneracyOperations Research Letters, 1989
- Biased predictors, rationality and the evaluation of forecastsEconomics Letters, 1986