Gonzague Henri
Gonzague Henri has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Ning Lu
North Carolina State University
2 shared publications Carlos Carrejo
Energy Management System Department Total Paris France
1 shared publication- Philippe Cordier
TotalEnergies, OneTech, One R&D, Palaiseau, France
1 shared publication Philippe Preux
Université de Lille CRNS Lille France
1 shared publicationRéda Alami
Total Palaiseau France
1 shared publication- Tanguy Levent
Ecole Polytechnique CNRS IP Paris Palaiseau France
1 shared publication
Latest Publications
- Open Access
- 13 January 2021
- Published by Institution of Engineering and Technology (IET) in IET Smart Grid
- Vol. 4 (1) , 15-28
The challenge of controlling microgrids in the presence of rare events with deep reinforcement learning
The increased penetration of renewable energies and the need to decarbonise the grid come with a lot of challenges. Microgrids, power grids that can operate independently from the main system, are seen as a promising solution. They range from a small building to a neighbourhood or a village. As they co‐locate generation, storage and consumption, microgrids are often built with renewable energies. At the same time, because they can be disconnected from the main grid, they can be more resilient and less dependent on central generation. Due to their diversity and distributed nature, advanced metering and control will be necessary to maximise their potential. This paper presents a reinforcement learning algorithm to tackle the energy management of an off‐grid microgrid, represented as a Markov Decision Process. The main objective function of the proposed algorithm is to minimise the global operating cost. By nature, rare events occur in physical systems. One of the main contribution of this paper is to demonstrate how to train agents in the presence of rare events. Merging the combined experience replay method with novel methods called ‘Memory Counter’ unstucks the agent during its learning phase. Compared to baselines, an extended version of double deep Q ‐network with a priority list of actions into the decision making strategy process lowers significantly the operating cost. Experiments are conducted using 2 years of real‐world data from Ecole Polytechnique in France.
- 13 January 2021
- Published by Institution of Engineering and Technology (IET) in IET Smart Grid
- Vol. 4 (1) , 15-28
Open AccessThe challenge of controlling microgrids in the presence of rare events with deep reinforcement learning
The increased penetration of renewable energies and the need to decarbonise the grid come with a lot of challenges. Microgrids, power grids that can operate independently from the main system, are seen as a promising solution. They range from a small building to a neighbourhood or a village. As they co‐locate generation, storage and consumption, microgrids are often built with renewable energies. At the same time, because they can be disconnected from the main grid, they can be more resilient and less dependent on central generation. Due to their diversity and distributed nature, advanced metering and control will be necessary to maximise their potential. This paper presents a reinforcement learning algorithm to tackle the energy management of an off‐grid microgrid, represented as a Markov Decision Process. The main objective function of the proposed algorithm is to minimise the global operating cost. By nature, rare events occur in physical systems. One of the main contribution of this paper is to demonstrate how to train agents in the presence of rare events. Merging the combined experience replay method with novel methods called ‘Memory Counter’ unstucks the agent during its learning phase. Compared to baselines, an extended version of double deep Q ‐network with a priority list of actions into the decision making strategy process lowers significantly the operating cost. Experiments are conducted using 2 years of real‐world data from Ecole Polytechnique in France.
- 8 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 10 (6) , 5910-5919
A Supervised Machine Learning Approach to Control Energy Storage Devices
- 8 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 10 (6) , 5910-5919
A Supervised Machine Learning Approach to Control Energy Storage Devices
- Open Access
- 23 January 2019
- Published by Institution of Engineering and Technology (IET) in IET Smart Grid
- Vol. 2 (1) , 69-76
Mode‐based energy storage control approach for residential photovoltaic systems
This study presents a novel mode‐based energy storage control approach. Assuming that an energy storage device (ESD) is equipped with a set of predetermined real‐time control modes, the dispatch objective is to select an optimal mode instead of a continuous charging or discharging power value. A two‐stage algorithm is developed for mode selection. In the first stage, a sliding 24 h economic model predictive control algorithm is used to determine the power outputs of the ESD for the next 24 h. In the second stage, the output sign for the next time step determines the class of modes to be elected (charging or discharging). The information from the first stage is used to compute the total cost for each selected mode. The mode with the lowest day‐ahead cost is chosen. The residential electricity consumption data collected in the PECAN Street Project is used in the simulation to validate the performance of the proposed algorithm. Simulation results show that using a mode‐based approach reduces the sensitivity to forecasting errors along with load and solar variability. The algorithm performance is consistent across different load patterns.
- 23 January 2019
- Published by Institution of Engineering and Technology (IET) in IET Smart Grid
- Vol. 2 (1) , 69-76
Open AccessMode‐based energy storage control approach for residential photovoltaic systems
This study presents a novel mode‐based energy storage control approach. Assuming that an energy storage device (ESD) is equipped with a set of predetermined real‐time control modes, the dispatch objective is to select an optimal mode instead of a continuous charging or discharging power value. A two‐stage algorithm is developed for mode selection. In the first stage, a sliding 24 h economic model predictive control algorithm is used to determine the power outputs of the ESD for the next 24 h. In the second stage, the output sign for the next time step determines the class of modes to be elected (charging or discharging). The information from the first stage is used to compute the total cost for each selected mode. The mode with the lowest day‐ahead cost is chosen. The residential electricity consumption data collected in the PECAN Street Project is used in the simulation to validate the performance of the proposed algorithm. Simulation results show that using a mode‐based approach reduces the sensitivity to forecasting errors along with load and solar variability. The algorithm performance is consistent across different load patterns.