TPThijs Peirelinck

Thijs Peirelinck

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Thijs Peirelinck has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Physiological control for left ventricular assist devices based on deep reinforcement learning

    by Diego Fernández‐Zapico, Thijs Peirelinck, Geert Deconinck, Dirk W. Donker, Libera Fresiello

    Background: The improvement of controllers of left ventricular assist device (LVAD) technology supporting heart failure (HF) patients has enormous impact, given the high prevalence and mortality of HF in the population. The use of reinforcement learning for control applications in LVAD remains minimally explored. This work introduces a preload‐based deep reinforcement learning control for LVAD based on the proximal policy optimization algorithm.Methods: The deep reinforcement learning control is built upon data derived from a deterministic high‐fidelity cardiorespiratory simulator exposed to variations of total blood volume, heart rate, systemic vascular resistance, pulmonary vascular resistance, right ventricular end‐systolic elastance, and left ventricular end‐systolic elastance, to replicate realistic inter‐ and intra‐patient variability of patients with a severe HF supported by LVAD. The deep reinforcement learning control obtained in this work is trained to avoid ventricular suction and allow aortic valve opening by using left ventricular pressure signals: end‐diastolic pressure, maximum pressure in the left ventricle (LV), and maximum pressure in the aorta.Results: The results show controller obtained in this work, compared to the constant speed LVAD alternative, assures a more stable end‐diastolic volume (EDV), with a standard deviation of 5 mL and 9 mL, respectively, and a higher degree of aortic flow, with an average flow of 1.1 L/min and 0.9 L/min, respectively.Conclusion: This work implements a deep reinforcement learning controller in a high‐fidelity cardiorespiratory simulator, resulting in increases of flow through the aortic valve and increases of EDV stability, when compared to a constant speed LVAD strategy.


  • Open Access

    Combined peak reduction and self-consumption using proximal policy optimisation

    by Thijs Peirelinck, Chris Hermans, Fred Spiessens, Geert Deconinck


  • Open Access

    Transfer learning in demand response: A review of algorithms for data-efficient modelling and control

    by Thijs Peirelinck, Hussain Kazmi, Brida V. Mbuwir, Chris Hermans, Fred Spiessens, Johan Suykens, Geert Deconinck


  • Transfer learning for Demand Response of a Multi-Agent Battery and Electric Water Heater System

    by Thijs Peirelinck, Chris Hermans, Fred Spiessens, Geert Deconinck

    Renewable Energy Sources (RES) are ever more finding their way into today's power systems. They have many benefits, but hold challenges when it comes to operating the power system. Their intermittency defies the current prominent approach of keeping system balance; supply follows demand. Demand Response (DR) has been proposed numerous times to mitigate the challenges of RES. Additionally, Reinforcement Learning (RL) has been proposed numerous times to mitigate the scalability challenges of DR. Simultaneously, RL has been criticised for its data inefficiency. In an effort to tackle this problem, we showcase a transfer learning approach in a DR setting. The application consists of a household, equipped with inflexible load, a rooftop solar installation, an Electric Water Heater (EWH) and a battery. The household's electrical energy consumption is billed according to a Time-of-Use-pricing scheme. In this multi-agent DR application, two RL-agents, one for the EWH and one for the battery, have to efficiently operate the system. We show that in our scenario RL, combined with pretraining of the battery-agent, reduces operation cost by 28.5 %, compared to rule-based control.

  • Open Access

    Domain Randomization for Demand Response of an Electric Water Heater

    by Thijs Peirelinck, Chris Hermans, Fred Spiessens, Geert Deconinck

    Thermostatically Controlled Loads (TCLs) provide a source of demand flexibility, and are often considered a good source for Demand Response (DR) applications. Due to their heterogeneity, and as such a lack of dynamics models, Reinforcement Learning (RL) is often used to exploit this flexibility. Unfortunately, RL requires exploratory interaction with the TCL, resulting in a period of potential discomfort for the users. We present an approach to reduce this exploratory time by pretraining the RL-agent. Domain randomization is used to facilitate knowledge transfer. We evaluate the pre-training potential in a DR energy arbitrage scenario with an Electric Water Heater (EWH). Our experiments show that a priori knowledge about EWH dynamics can be used to initialize and improve the control policy. In our experiments, pre-training attributes to 8.8 % additional cost savings, compared to starting from scratch.


  • Double Q-learning for Demand Response of an Electric Water Heater

    by Thijs Peirelinck, Chris Hermans, Fred Spiessens, Geert Deconinck

    Increasing the share of renewable energy sources in the electrical grid requires new balancing means. Therefore, activating flexibility at the demand side with Demand Response (DR) programs has gained significant attention in recent years. In this regard, Thermostatically Controlled Loads (TCLs) are interesting appliances, due to their inherent storage capacity. In this paper, double Q-learning is applied to an Electric Water Heater (EWH) in two different DR settings. The first assumes the EWH's energy consumption is billed according to a Time-of-Use (ToU) price. The second scenario assumes households have a power consumption limit. In both cases, the control policy learned with double Q-learning is compared to a thermostat controller. With ToU pricing the EWH consumes 35% less energy during peak hours. When the EWH is charged according to a capacity tariff Q-learning reduces power consumption limit surpasses by 31%.


  • Intelligent Electric Water Heater Control with Varying State Information

    by Christophe Patyn, Thijs Peirelinck, Geert Deconinck, Ann Nowe

    The increasing share of renewable energy sources in the electricity grid results in a higher degree of uncertainty regarding electrical energy production. In response to this, flexibility of the demand has been proposed as part of the solution. An important source of flexibility available at the residential consumer side are thermostatically controlled loads (TCLs). In this paper the activation of this source of flexibility is achieved by applying batch reinforcement learning (BRL) to an electric water heater (EWH) in a Time of Use (ToU) setting. The cost performance of six BRL agents with six different state spaces is compared quantitatively. In every case, the BRL agent can successfully shift energy consumption within 20-25 days. The performance of an agent with access to multiple temperature sensors along the height of the EWH is comparable to the performance of an agent with access to only the highest temperature sensor. This indicates manufacturing costs related to sensors can be reduced while maintaining the same performance. Additionally, results show that the inclusion of a theoretical state of charge value in the state space increases performance by more than 8% compared to the performance of the other BRL agents. It is therefore argued that an estimation of the state of charge should be included in future work as it would increase cost performance.


  • Using reinforcement learning for optimizing heat pump control in a building model in Modelica

    by Thijs Peirelinck, Frederik Ruelens, Geert Decnoninck

    With the increasing share of renewable energy sources in the electricity grid comes the need to exploit the available flexibility at the demand side. Demand response programs seek to exploit the flexibility of consumers by motivating end-users to shift demand based on grid signals. An important source of flexibility available at residential consumers are Thermostatically Controlled Loads (TCLs). Additionally, recent advances within the reinforcement learning area have made it possible to apply this technique to a large range of problems. Driven by these promising examples, a Batch Reinforcement Learning (BRL) algorithm is applied to a TCL. An important property of the complex optimization problem studied here, is its partial observability. The main contribution of this paper is the application of BRL to a detailed building and heating system model, implemented in Modelica. A detailed TCL model allows to perform an in-depth analysis of the effects of partial observability on the performance of the chosen control strategy. Ultimately, this paper illustrates that Modelica can be used to provide a detailed environment for a BRL algorithm. At the end, the learned control policy has been compared with two other control policies. The obtained policy outperforms both and is economically feasible after a limited amount of training days.