Manu Lahariya
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Manu Lahariya has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Chris Develder
Ghent University, Ghent, Belgium
4 shared publications - Guillaume Crevecoeur
Ghent University
3 shared publications - Farzaneh Karami
KU Leuven
2 shared publications - Bert Claessens
Beebop, Belgium
1 shared publication - Carlo Manna1 shared publication
Chris Develder
Authors are with IDLab Ghent University -imec Technologiepark- Zwijnaarde 126 9052 Ghent Belgium
1 shared publication
Latest Publications
- Open Access
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 347-351
Real-World Implementation of Reinforcement Learning Based Energy Coordination for a Cluster of Households
Given its substantial contribution of 40% to global power consumption, the built environment has received increasing attention to serve as a source of flexibility to assist the modern power grid. In that respect, previous research mainly focused on energy management of individual buildings. In contrast, in this paper, we focus on aggregated control of a set of residential buildings, to provide grid supporting services, that eventually should include ancillary services. In particular, we present a real-life pilot study that studies the effectiveness of reinforcement-learning (RL) in coordinating the power consumption of 8 residential buildings to jointly track a target power signal. Our RL approach relies solely on observed data from individual households and does not require any explicit building models or simulators, making it practical to implement and easy to scale. We show the feasibility of our proposed RL-based coordination strategy in a real-world setting. In a 4-week case study, we demonstrate a hierarchical control system, relying on an RL-based ranking system to select which households to activate flex assets from, and a real-time PI control-based power dispatch mechanism to control the selected assets. Our results demonstrate satisfactory power tracking, and the effectiveness of the RL-based ranks which are learnt in a purely data-driven manner.
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 347-351
Open AccessReal-World Implementation of Reinforcement Learning Based Energy Coordination for a Cluster of Households
Given its substantial contribution of 40% to global power consumption, the built environment has received increasing attention to serve as a source of flexibility to assist the modern power grid. In that respect, previous research mainly focused on energy management of individual buildings. In contrast, in this paper, we focus on aggregated control of a set of residential buildings, to provide grid supporting services, that eventually should include ancillary services. In particular, we present a real-life pilot study that studies the effectiveness of reinforcement-learning (RL) in coordinating the power consumption of 8 residential buildings to jointly track a target power signal. Our RL approach relies solely on observed data from individual households and does not require any explicit building models or simulators, making it practical to implement and easy to scale. We show the feasibility of our proposed RL-based coordination strategy in a real-world setting. In a 4-week case study, we demonstrate a hierarchical control system, relying on an RL-based ranking system to select which households to activate flex assets from, and a real-time PI control-based power dispatch mechanism to control the selected assets. Our results demonstrate satisfactory power tracking, and the effectiveness of the RL-based ranks which are learnt in a purely data-driven manner.
- 5 August 2023
- Published by Springer Nature
- p. 3009-3025
AQ-Learning-Based Demand Response Algorithm for Industrial Processes with Operational Flexibility
- 5 August 2023
- Published by Springer Nature
- p. 3009-3025
AQ-Learning-Based Demand Response Algorithm for Industrial Processes with Operational Flexibility
- Open Access
Learning physics-informed simulation models for soft robotic manipulation: A case study with dielectric elastomer actuators
Soft actuators offer a safe, adaptable approach to tasks like gentle grasping and dexterous manipulation. Creating accurate models to control such systems however is challenging due to the complex physics of deformable materials. Accurate Finite Element Method (FEM) models incur prohibitive computational complexity for closed-loop use. Using a differentiable simulator is an attractive alternative, but their applicability to soft actuators and deformable materials remains underexplored. This paper presents a framework that combines the advantages of both. We learn a differentiable model consisting of a material properties neural network and an analytical dynamics model of the remainder of the manipulation task. This physics-informed model is trained using data generated from FEM, and can be used for closed-loop control and inference. We evaluate our framework on a dielectric elastomer actuator (DEA) coin-pulling task. We simulate the task of using DEA to pull a coin along a surface with frictional contact, using FEM, and evaluate the physics-informed model for simulation, control, and inference. Our model attains < 5% simulation error compared to FEM, and we use it as the basis for an MPC controller that requires fewer iterations to converge than model-free actor-critic, PD, and heuristic policies.
Open AccessLearning physics-informed simulation models for soft robotic manipulation: A case study with dielectric elastomer actuators
Soft actuators offer a safe, adaptable approach to tasks like gentle grasping and dexterous manipulation. Creating accurate models to control such systems however is challenging due to the complex physics of deformable materials. Accurate Finite Element Method (FEM) models incur prohibitive computational complexity for closed-loop use. Using a differentiable simulator is an attractive alternative, but their applicability to soft actuators and deformable materials remains underexplored. This paper presents a framework that combines the advantages of both. We learn a differentiable model consisting of a material properties neural network and an analytical dynamics model of the remainder of the manipulation task. This physics-informed model is trained using data generated from FEM, and can be used for closed-loop control and inference. We evaluate our framework on a dielectric elastomer actuator (DEA) coin-pulling task. We simulate the task of using DEA to pull a coin along a surface with frictional contact, using FEM, and evaluate the physics-informed model for simulation, control, and inference. Our model attains < 5% simulation error compared to FEM, and we use it as the basis for an MPC controller that requires fewer iterations to converge than model-free actor-critic, PD, and heuristic policies.
- 10 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 19 (2) , 1484-1494
Physics-Informed LSTM Network for Flexibility Identification in Evaporative Cooling System
In energy-intensive industrial systems, an evaporative cooling process may introduce operational flexibility. Such flexibility refers to a system’s ability to deviate from its scheduled energy consumption. Identifying the flexibility, and therefore, designing control that ensures efficient and reliable operation presents a great challenge due to the inherently complex dynamics of industrial systems. Recently, machine learning (ML) models have attracted attention for identifying flexibility, due to their ability to model complex nonlinear behavior. This article presents ML-based methods that integrate system dynamics into the ML models (e.g., neural networks) for better adherence to physical constraints. We define and evaluate physics-informed long-short term memory networks (PhyLSTMs) and physics-informed neural networks (PhyNN) for the identification of flexibility in the evaporative cooling process. These physics-informed networks approximate the time-dependent relationship between control input and system response while enforcing the dynamics of the process in the neural network architecture. Our proposed PhyLSTM provides less than 2% system response estimation error, converges in less than half iterations compared to a baseline NN, and accurately estimates the defined flexibility metrics. We include a detailed analysis of the impact of training data size on the performance and optimization of our proposed models.
- 10 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 19 (2) , 1484-1494
Physics-Informed LSTM Network for Flexibility Identification in Evaporative Cooling System
In energy-intensive industrial systems, an evaporative cooling process may introduce operational flexibility. Such flexibility refers to a system’s ability to deviate from its scheduled energy consumption. Identifying the flexibility, and therefore, designing control that ensures efficient and reliable operation presents a great challenge due to the inherently complex dynamics of industrial systems. Recently, machine learning (ML) models have attracted attention for identifying flexibility, due to their ability to model complex nonlinear behavior. This article presents ML-based methods that integrate system dynamics into the ML models (e.g., neural networks) for better adherence to physical constraints. We define and evaluate physics-informed long-short term memory networks (PhyLSTMs) and physics-informed neural networks (PhyNN) for the identification of flexibility in the evaporative cooling process. These physics-informed networks approximate the time-dependent relationship between control input and system response while enforcing the dynamics of the process in the neural network architecture. Our proposed PhyLSTM provides less than 2% system response estimation error, converges in less than half iterations compared to a baseline NN, and accurately estimates the defined flexibility metrics. We include a detailed analysis of the impact of training data size on the performance and optimization of our proposed models.
- Open Access
Synthetic Data Generator for Electric Vehicle Charging Sessions: Modeling and Evaluation Using Real-World Data
Electric vehicle (EV) charging stations have become prominent in electricity grids in the past few years. Their increased penetration introduces both challenges and opportunities; they contribute to increased load, but also offer flexibility potential, e.g., in deferring the load in time. To analyze such scenarios, realistic EV data are required, which are hard to come by. Therefore, in this article we define a synthetic data generator (SDG) for EV charging sessions based on a large real-world dataset. Arrival times of EVs are modeled assuming that the inter-arrival times of EVs follow an exponential distribution. Connection time for EVs is dependent on the arrival time of EV, and can be described using a conditional probability distribution. This distribution is estimated using Gaussian mixture models, and departure times can calculated by sampling connection times for EV arrivals from this distribution. Our SDG is based on a novel method for the temporal modeling of EV sessions, and jointly models the arrival and departure times of EVs for a large number of charging stations. Our SDG was trained using real-world EV sessions, and used to generate synthetic samples of session data, which were statistically indistinguishable from the real-world data. We provide both (i) source code to train SDG models from new data, and (ii) trained models that reflect real-world datasets.
Open AccessSynthetic Data Generator for Electric Vehicle Charging Sessions: Modeling and Evaluation Using Real-World Data
Electric vehicle (EV) charging stations have become prominent in electricity grids in the past few years. Their increased penetration introduces both challenges and opportunities; they contribute to increased load, but also offer flexibility potential, e.g., in deferring the load in time. To analyze such scenarios, realistic EV data are required, which are hard to come by. Therefore, in this article we define a synthetic data generator (SDG) for EV charging sessions based on a large real-world dataset. Arrival times of EVs are modeled assuming that the inter-arrival times of EVs follow an exponential distribution. Connection time for EVs is dependent on the arrival time of EV, and can be described using a conditional probability distribution. This distribution is estimated using Gaussian mixture models, and departure times can calculated by sampling connection times for EV arrivals from this distribution. Our SDG is based on a novel method for the temporal modeling of EV sessions, and jointly models the arrival and departure times of EVs for a large number of charging stations. Our SDG was trained using real-world EV sessions, and used to generate synthetic samples of session data, which were statistically indistinguishable from the real-world data. We provide both (i) source code to train SDG models from new data, and (ii) trained models that reflect real-world datasets.
- 24 February 2012
- Published by Springer Nature
- p. 1-17
A Q-Learning Based Demand Response Algorithm for Industrial Processes with Flexibility
- 24 February 2012
- Published by Springer Nature
- p. 1-17
A Q-Learning Based Demand Response Algorithm for Industrial Processes with Flexibility