Hongbin Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hongbin Sun has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Hongchang Ke
School of Computer Technology and Engineering, Changchun Institute of Technology, Changchun 130012, China
2 shared publications - Hui Wang
College of Computer Science and Engineering, Changchun University of Technology, Changchun 130012, China
2 shared publications Carl Brown
Texas A&M University
1 shared publicationChangxin Meng
Texas A&M University
1 shared publication- Hu Bin
Department of Electrical Engineering, Texas A&M University, College Station, USA
1 shared publication - Jinsong Sang
Changchun Institute of Technology, School of Electrical Engineering, Changchun 130012, China
1 shared publication
Latest Publications
- 30 August 2023
- Published by Springer Nature in Applied Intelligence
- Vol. 53 (22) , 26885-26906
Deep Reinforcement Learning-based Power Control and Bandwidth Allocation Policy for Weighted Cost Minimization in Wireless Networks
- 30 August 2023
- Published by Springer Nature in Applied Intelligence
- Vol. 53 (22) , 26885-26906
Deep Reinforcement Learning-based Power Control and Bandwidth Allocation Policy for Weighted Cost Minimization in Wireless Networks
- Open Access
- 31 July 2022
- Published by MDPI AG in Electronics
- Vol. 11 (15) , 2394
Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment
In the dense data communication environment of 5G wireless networks, with the dramatic increase in the amount of request computation tasks generated by intelligent wireless mobile nodes, its computation ability cannot meet the requirements of low latency and high reliability. Mobile edge computing (MEC) can utilize its servers with mighty computation power and closer to tackle the computation tasks offloaded by the wireless node (WN). The physical location of the MEC server is closer to WN, thereby meeting the requirements of low latency and high reliability. In this paper, we implement an MEC framework with multiple WNs and multiple MEC servers, which consider the randomness and divisibility of arrival request tasks from WN, the time-varying channel state between WN and MEC server, and different priorities of tasks. In the proposed MEC system, we present a decentralized multi-agent deep reinforcement learning-based partial task offloading and resource allocation algorithm (DeMADRL) to minimize the long-term weighted cost including delay cost and bandwidth cost. DeMADRL is a model-free scheme based on Double Deep Q-Learning (DDQN) and can obtain the optimal computation offloading and bandwidth allocation decision-making policy by training the neural networks. The comprehensive simulation results show that the proposed DeMADRL optimization scheme has a nice convergence and outperforms the other three baseline algorithms.
- 31 July 2022
- Published by MDPI AG in Electronics
- Vol. 11 (15) , 2394
Open AccessMulti-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment
In the dense data communication environment of 5G wireless networks, with the dramatic increase in the amount of request computation tasks generated by intelligent wireless mobile nodes, its computation ability cannot meet the requirements of low latency and high reliability. Mobile edge computing (MEC) can utilize its servers with mighty computation power and closer to tackle the computation tasks offloaded by the wireless node (WN). The physical location of the MEC server is closer to WN, thereby meeting the requirements of low latency and high reliability. In this paper, we implement an MEC framework with multiple WNs and multiple MEC servers, which consider the randomness and divisibility of arrival request tasks from WN, the time-varying channel state between WN and MEC server, and different priorities of tasks. In the proposed MEC system, we present a decentralized multi-agent deep reinforcement learning-based partial task offloading and resource allocation algorithm (DeMADRL) to minimize the long-term weighted cost including delay cost and bandwidth cost. DeMADRL is a model-free scheme based on Double Deep Q-Learning (DDQN) and can obtain the optimal computation offloading and bandwidth allocation decision-making policy by training the neural networks. The comprehensive simulation results show that the proposed DeMADRL optimization scheme has a nice convergence and outperforms the other three baseline algorithms.
- Open Access
Deep Reinforcement Learning Microgrid Optimization Strategy Considering Priority Flexible Demand Side
As an efficient way to integrate multiple distributed energy resources (DERs) and the user side, a microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs. The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid. In response to this problem, the overall environment of wind power, thermostatically controlled loads (TCLs), energy storage systems (ESSs), price-responsive loads and the main grid is proposed. Secondly, the centralized control of the microgrid operation is convenient for the control of the reactive power and voltage of the distributed power supply and the adjustment of the grid frequency. However, there is a problem in that the flexible loads aggregate and generate peaks during the electricity price valley. The existing research takes into account the power constraints of the microgrid and fails to ensure a sufficient supply of electric energy for a single flexible load. This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid so as to ensure the power supply of the flexible load of the microgrid and save the power input cost to the greatest extent. Finally, the simulation optimization of the environment can be expressed as a Markov decision process (MDP) process. It combines two stages of offline and online operations in the training process. The addition of multiple threads with the lack of historical data learning leads to low learning efficiency. The asynchronous advantage actor–critic (Memory A3C, M-A3C) with the experience replay pool memory library is added to solve the data correlation and nonstatic distribution problems during training. The multithreaded working feature of M-A3C can efficiently learn the resource priority allocation on the demand side of the microgrid and improve the flexible scheduling of the demand side of the microgrid, which greatly reduces the input cost. Comparison of the researched cost optimization results with the results obtained with the proximal policy optimization (PPO) algorithm reveals that the proposed algorithm has better performance in terms of convergence and optimization economics.
Open AccessDeep Reinforcement Learning Microgrid Optimization Strategy Considering Priority Flexible Demand Side
As an efficient way to integrate multiple distributed energy resources (DERs) and the user side, a microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs. The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid. In response to this problem, the overall environment of wind power, thermostatically controlled loads (TCLs), energy storage systems (ESSs), price-responsive loads and the main grid is proposed. Secondly, the centralized control of the microgrid operation is convenient for the control of the reactive power and voltage of the distributed power supply and the adjustment of the grid frequency. However, there is a problem in that the flexible loads aggregate and generate peaks during the electricity price valley. The existing research takes into account the power constraints of the microgrid and fails to ensure a sufficient supply of electric energy for a single flexible load. This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid so as to ensure the power supply of the flexible load of the microgrid and save the power input cost to the greatest extent. Finally, the simulation optimization of the environment can be expressed as a Markov decision process (MDP) process. It combines two stages of offline and online operations in the training process. The addition of multiple threads with the lack of historical data learning leads to low learning efficiency. The asynchronous advantage actor–critic (Memory A3C, M-A3C) with the experience replay pool memory library is added to solve the data correlation and nonstatic distribution problems during training. The multithreaded working feature of M-A3C can efficiently learn the resource priority allocation on the demand side of the microgrid and improve the flexible scheduling of the demand side of the microgrid, which greatly reduces the input cost. Comparison of the researched cost optimization results with the results obtained with the proximal policy optimization (PPO) algorithm reveals that the proposed algorithm has better performance in terms of convergence and optimization economics.
- 9 January 2019
- Published by Springer Nature in Evolutionary Intelligence
- Vol. 12 (3) , 385-394
Short-term electrical load forecasting method based on stacked auto-encoding and GRU neural network
- 9 January 2019
- Published by Springer Nature in Evolutionary Intelligence
- Vol. 12 (3) , 385-394
Short-term electrical load forecasting method based on stacked auto-encoding and GRU neural network
- 30 December 2017
- Published by Springer Nature in Wireless Personal Communications
- Vol. 102 (2) , 1073-1084
A Short-Term Power Load Prediction Algorithm of Based on Power Load Factor Deep Cluster Neural Network
- 30 December 2017
- Published by Springer Nature in Wireless Personal Communications
- Vol. 102 (2) , 1073-1084
A Short-Term Power Load Prediction Algorithm of Based on Power Load Factor Deep Cluster Neural Network
- 4 October 2017
- Published by Springer Nature in Cluster Computing
- Vol. 22 (S3) , 5293-5303
Self-healing reconfiguration scheme for distribution network with distributed generations based on multi-agent systems
- 4 October 2017
- Published by Springer Nature in Cluster Computing
- Vol. 22 (S3) , 5293-5303
Self-healing reconfiguration scheme for distribution network with distributed generations based on multi-agent systems