Haoran Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Haoran Wang has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Jinglin Li
School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China
2 shared publications - Wendong Xiao
School of Automation & Electrical Engineering, University of Science and Technology Beijing, Beijing, China
2 shared publications - Chengpeng Jiang
School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China
1 shared publication - Jing Wang
Beijing Engineering Research Center of Industrial Spectrum Imaging, Beijing 100083, China
1 shared publication - Shuai Chen
School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China
1 shared publication - Taian Xu
School of Information Science and Engineering, Zaozhuang University, Zaozhuang 277160, China
1 shared publication
Latest Publications
- Open Access
- 23 July 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (14) , 8513
Mobile Charging Scheduling Approach for Wireless Rechargeable Sensor Networks Based on Multiple Discrete-Action Space Deep Q-Network
Wireless energy transfer technology (WET)-enabled mobile charging provides an innovative strategy for energy replenishment in wireless rechargeable sensor networks (WRSNs), where the mobile charger (MC) can charge the sensors sequentially by WET according to the mobile charging scheduling scheme. Although there have been fruitful studies, they usually assume that all sensors will be charged fully once scheduled or charged to a fixed percentage determined by a charging upper threshold, resulting in low charging performance as they cannot adjust the charging operation on each sensor adaptively according to the real-time charging demands. To tackle this challenge, we first formulate the mobile charging scheduling as a joint mobile charging sequence scheduling and charging upper threshold control problem (JSSTC), where the charging upper threshold of each sensor can adjust adaptively. Then, we propose a novel multi-discrete action space deep Q-network approach for JSSTC (MDDRL-JSSTC), where MC is regarded as an agent exploring the environment. The state information observed by MC at each time step is encoded to construct a high-dimensional vector. Furthermore, a two-dimensional action is mapped to the charging destination of MC and the corresponding charging upper threshold at the next time step, using bidirectional gated recurrent units (Bi-GRU). Finally, we conduct a series of experiments to verify the superior performance of the proposed approach in prolonging the lifetime compared with the state-of-the-art approaches.
- 23 July 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (14) , 8513
Open AccessMobile Charging Scheduling Approach for Wireless Rechargeable Sensor Networks Based on Multiple Discrete-Action Space Deep Q-Network
Wireless energy transfer technology (WET)-enabled mobile charging provides an innovative strategy for energy replenishment in wireless rechargeable sensor networks (WRSNs), where the mobile charger (MC) can charge the sensors sequentially by WET according to the mobile charging scheduling scheme. Although there have been fruitful studies, they usually assume that all sensors will be charged fully once scheduled or charged to a fixed percentage determined by a charging upper threshold, resulting in low charging performance as they cannot adjust the charging operation on each sensor adaptively according to the real-time charging demands. To tackle this challenge, we first formulate the mobile charging scheduling as a joint mobile charging sequence scheduling and charging upper threshold control problem (JSSTC), where the charging upper threshold of each sensor can adjust adaptively. Then, we propose a novel multi-discrete action space deep Q-network approach for JSSTC (MDDRL-JSSTC), where MC is regarded as an agent exploring the environment. The state information observed by MC at each time step is encoded to construct a high-dimensional vector. Furthermore, a two-dimensional action is mapped to the charging destination of MC and the corresponding charging upper threshold at the next time step, using bidirectional gated recurrent units (Bi-GRU). Finally, we conduct a series of experiments to verify the superior performance of the proposed approach in prolonging the lifetime compared with the state-of-the-art approaches.