Echo state network‐based Q‐learning method for optimal battery control of offices combined with renewable energy
Authors:
Open Access
- 14 February 2017
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Control Theory & Applications
- Vol. 11 (7) , 915-922
Abstract
An echo state network (ESN)‐based Q‐learning method is developed for optimal energy management of an office, where the solar energy is introduced as the renewable source, and a battery is installed with a control unit. The energy consumption in the office, also considered as the energy demand, is separated into those from sockets, lights and air‐conditioners. First, ESNs, well known for their excellent modelling performance for time series, are employed to model the time series of the real‐time electricity rate, renewable energy and energy demand as periodic functions. Second, given the periodic models of the electricity rate, renewable energy and energy demand, an ESN‐based Q‐learning method with the Q‐function approximated by an ESN is developed and implemented to determine the optimal charging/discharging/idle strategies for the battery in the office, so that the total cost of electricity from the grid can be reduced. Finally, numerical analysis is conducted to illustrate the performance of the developed method.Keywords
Funding Information
- National Natural Science Foundation of China (61233001, 61273140, 61374105, 61533017, U1501251)
This publication has 37 references indexed in Scilit:
- A Novel Iterative $\theta $-Adaptive Dynamic Programming for Discrete-Time Nonlinear SystemsIEEE Transactions on Automation Science and Engineering, 2013
- Numerical adaptive learning control scheme for discrete‐time non‐linear systemsIET Control Theory & Applications, 2013
- Neural-network-based zero-sum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithmNeurocomputing, 2013
- Action dependent heuristic dynamic programming for home energy resource schedulingInternational Journal of Electrical Power & Energy Systems, 2013
- Adaptive Dynamic Programming Algorithm for Renewable Energy Scheduling and Battery ManagementCognitive Computation, 2012
- Approximate dynamic programming for continuous-time linear quadratic regulator problems: relaxation of known input-coupling matrix assumptionIET Control Theory & Applications, 2012
- Neural network-based compensation control of mobile robots with partially known structureIET Control Theory & Applications, 2012
- Prediction for noisy nonlinear time series by echo state network based on dual estimationNeurocomputing, 2012
- A self-learning scheme for residential energy system control and managementNeural Computing and Applications, 2011
- An associative memory readout for ESNs with applications to dynamical pattern recognitionNeural Networks, 2007