Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing
Authors:
- Leye WangLWLeye Wang
- Wenbin LiuWLWenbin Liu
- Daqing ZhangDZDaqing Zhang
- Yasha WangYWYasha Wang
- En WangEWEn Wang
- Yongjian YangYYYongjian Yang
- 1 July 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1543-1546
Abstract
Sparse Mobile CrowdSensing (MCS) is a novel MCS paradigm where data inference is incorporated into the MCS process for reducing sensing costs while its quality is guaranteed. Since the sensed data from different cells (sub-areas) of the target sensing area will probably lead to diverse levels of inference data quality, cell selection (i.e., choose which cells of the target area to collect sensed data from participants) is a critical issue that will impact the total amount of data that requires to be collected (i.e., data collection costs) for ensuring a certain level of quality. To address this issue, this paper proposes a Deep Reinforcement learning based Cell selection mechanism for Sparse MCS, called DR-Cell. We properly model the key concepts in reinforcement learning including state, action, and reward, and then propose to use a deep recurrent Q-network for learning the Q-function that can help decide which cell is a better choice under a certain state during cell selection. Experiments on various real-life sensing datasets verify the effectiveness of DR-Cell over the state-of-the-art cell selection mechanisms in Sparse MCS by reducing up to 15% of sensed cells with the same data inference quality guarantee.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- SPACE-TAACM Transactions on Intelligent Systems and Technology, 2017
- Sparse mobile crowdsensing: challenges and opportunitiesIEEE Communications Magazine, 2016
- CCS-TA2015
- More with less2015
- EMC3: Energy-efficient data transfer in mobile crowdsensing under full coverage constraintIEEE Transactions on Mobile Computing, 2014
- 4W1H in mobile crowd sensingIEEE Communications Magazine, 2014
- U-Air2013
- A Compressive Sensing Approach to Urban Traffic Estimation with Probe VehiclesIEEE Transactions on Mobile Computing, 2012
- Ear-phone2010
- SensorScopeACM Transactions on Sensor Networks, 2010