Real-Time Power Management for Embedded M2M Using Intelligent Learning Methods
Author:
Open Access
- 23 July 2014
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 13 (5s) , 1-22
Abstract
In this work, an embedded system working model is designed with one server that receives requests by a requester by a service queue that is monitored by a Power Manager (PM). A novel approach is presented based on reinforcement learning to predict the best policy amidst existing DPM policies and deterministic markovian nonstationary policies (DMNSP). We apply reinforcement learning, namely a computational approach to understanding and automating goal-directed learning that supports different devices according to their DPM. Reinforcement learning uses a formal framework defining the interaction between agent and environment in terms of states, response action, and reward points. The capability of this approach is demonstrated by an event-driven simulator designed using Java with a power-manageable machine-to-machine device. Our experiment result shows that the proposed dynamic power management with timeout policy gives average power saving from 4% to 21% and the novel dynamic power management with DMNSP gives average power saving from 10% to 28% more than already proposed DPM policies.Keywords
This publication has 21 references indexed in Scilit:
- Mobility Aware Energy Efficient Congestion Control in Mobile Wireless Sensor NetworkInternational Journal of Distributed Sensor Networks, 2014
- Dynamic Power Management for Ubiquitous Network DevicesAdvanced Science Letters, 2013
- Parallel Reconfigurable Computing-Based Mapping Algorithm for Motion Estimation in Advanced Video CodingACM Transactions on Embedded Computing Systems, 2012
- Fault reconstruction and state estimation with sliding mode observers for Lipschitz non-linear systemsIET Control Theory & Applications, 2011
- Computation Aware Scheme for Visual Signal ProcessingJournal of Software, 2010
- Hierarchical Adaptive Dynamic Power ManagementIEEE Transactions on Computers, 2005
- Dynamic power management in wireless sensor networksIEEE Design & Test of Computers, 2001
- Policy optimization for dynamic power managementIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 1999
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Toward power-sensitive network architectures in wireless communications: concepts, issues, and design aspectsIEEE Wireless Communications, 1998