Q-Learning Algorithm for Energy Management in Solar Powered Embedded Monitoring Systems
Authors:
- 1 July 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Environmental changes have become a considerable issue over the past years. To be able to continuously monitor such variations in the environment, it is convenient to employ so-called Environmental Monitoring Systems (EMS) that can be deployed in remote places of interest, and that are capable of measuring multiple ambient characteristics. However, supplying EMS with power in a long term to prevent blackouts is challenging. This paper introduces an energy management method based on Reinforcement Learning algorithm, particularly Q-learning. The EMS described in this study needs to meet a set of strict requirements, e.g. low power consumption, high reliability, self-sustainability with respect to power supply, backup of data acquired through the measurements in case of an unexpected failure and many others. The energy is harvested using solar panels and stored in supercapacitors. In addition, the implementation of a complex algorithm is not suitable for such a system, considering the energy constraints. The solution to the above mentioned challenges is described in this study. The findings were implemented in a physical EMS device, and subsequently tested in field so as to acquire real-life data.Keywords
This publication has 14 references indexed in Scilit:
- Dynamic energy management of energy harvesting wireless sensor nodes using fuzzy inference system with reinforcement learning2015
- Fuzzy Energy Management of Autonomous Weather Station∗∗This work was supported by project SP2015/154, Development of algorithms and systems for control, measurement and safety applications. of Student Grant System, VSB-TU Ostrava.IFAC-PapersOnLine, 2015
- Fuzzy algorithm for intelligent wireless sensors with solar harvesting2014
- Powering Environmental Monitoring Systems in Arctic Regions: A Simulation StudyElektronika ir Elektrotechnika, 2014
- Reinforcement learning for optimal energy management of a solar microgrid2014
- Fuzzy power management for environmental monitoring systems in tropical regions2014
- A Reinforcement Learning-Based ToD Provisioning Dynamic Power Management for Sustainable Operation of Energy Harvesting Wireless Sensor NodeIEEE Transactions on Emerging Topics in Computing, 2014
- Flexible power consumption management using Q learning techniques in a smart home2013
- Reinforcement learning for microgrid energy managementEnergy, 2013
- Metropolis Criterion Based Fuzzy Q-Learning Energy Management for Smart GridsTELKOMNIKA Indonesian Journal of Electrical Engineering, 2012