Deep Reinforced Learning Tree for Spatiotemporal Monitoring With Mobile Robotic Wireless Sensor Networks
- 17 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 50 (11) , 4197-4211
Abstract
This paper concerns the deployment problem of wireless sensor networks (WSNs) with mobile robotic sensor nodes for spatiotemporal monitoring. The proposed approach, deep reinforced learning tree (DRLT), utilizes deep reinforcement learning (DRL) to improve the efficiency of searching the most informative sampling locations. The parameterized sampling locations in an infinite horizon space are modeled according to their spatiotemporal correlations and subject to various constraints, including field estimation error and information gain. And the model-based information gain can be calculated efficiently over an infinite horizon. In this manner, the effectiveness of the sampling locations is learned through DRLT during the exploration by the robotic sensors. Then DRLT can instruct the robotic sensors to avoid unnecessary sampling locations in future iterations. Also, it is proved in this paper that the proposed algorithm is capable of searching for the near-optimal sampling locations effectively and guaranteeing a minimum field estimation error. Simulation based on national oceanic and atmospheric administration (NOAA) datasets is presented, which demonstrates the significant enhancements made by the proposed algorithm. Compared with the traditional approaches, such as the information theory-based greedy approach or random sampling, the proposed method shows a superior performance with regard to both estimation error and planning efficiency.Keywords
Funding Information
- India–Canada Centre for Innovative Multidisciplinary Partnership to Accelerate Community Transformation and Sustainability (11R18083)
This publication has 52 references indexed in Scilit:
- A spatial correlation aware algorithm to perform efficient data collection in wireless sensor networksAd Hoc Networks, 2014
- Active node determination for correlated data gathering in wireless sensor networksComputer Networks, 2013
- Sampling-based algorithms for optimal motion planningThe International Journal of Robotics Research, 2011
- Reinforcement learning can account for associative and perceptual learning on a visual-decision taskNature Neuroscience, 2009
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Efficient gathering of correlated data in sensor networksACM Transactions on Sensor Networks, 2008
- NOMADS: A Climate and Weather Model Archive at the National Oceanic and Atmospheric AdministrationBulletin of the American Meteorological Society, 2006
- Spatio-temporal correlation: theory and applications for wireless sensor networksComputer Networks, 2004
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960