Yushen Miao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Yushen Miao has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Shengrong Bu
Department of Engineering, Brock University, St. Catharines, ON, Canada
2 shared publications - Zhu Han
University of Houston
2 shared publications - Dawei Qiu
Nanyang Technological University
1 shared publication - Hao Liang
University of Alberta
1 shared publication Tianyi Chen
Flexitricity Limited, Edinburgh, U.K.
1 shared publication- Tianyi Chen
James Watt School of Engineering, University of Glasgow, Glasgow, U.K.
1 shared publication
Latest Publications
- 3 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 13, 3209-3223
Adaptive Resilient Control Against False Data Injection Attacks for a Multi-Energy Microgrid Integrating Power and Hydrogen Energy Systems Using Deep Reinforcement Learning
Due to the benefits of using hydrogen energy, such as enhanced system reliability, reduced $CO_{2}$ emissions, and long-term sustainability, the integration of hydrogen energy systems with power systems in multi-energy microgrids (MEMGs) has attracted increasing research interest. The widespread adoption of information and communication technologies has also increased the risk of cyber-attacks on MEMGs. False data injection attacks (FDIAs), a common type of cyber attack, could falsify energy arbitrage commands, thereby affecting the secondary frequency regulation and degrading the power quality of the MEMG. These attacks not only affect the normal operations of the MEMG but also reduce its economic profit. To address these issues, this paper proposes a novel deep reinforcement learning-based adaptive resilient control scheme to coordinate the energy conversion between electricity and hydrogen to eliminate the frequency deviation and maximize daily total revenue. Unlike traditional optimization techniques, the proposed deep reinforcement learning-based approach enables real-time adaption to dynamic and adversarial conditions, allowing the system to learn optimal strategies and improve resilience against FDIAs. Case studies with real-world datasets show that as the attack injection level increases from 5% to 20%, the proposed method maintains zero frequency deviation, with the total revenue decreasing by only 1.8%.
- 3 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 13, 3209-3223
Adaptive Resilient Control Against False Data Injection Attacks for a Multi-Energy Microgrid Integrating Power and Hydrogen Energy Systems Using Deep Reinforcement Learning
Due to the benefits of using hydrogen energy, such as enhanced system reliability, reduced $CO_{2}$ emissions, and long-term sustainability, the integration of hydrogen energy systems with power systems in multi-energy microgrids (MEMGs) has attracted increasing research interest. The widespread adoption of information and communication technologies has also increased the risk of cyber-attacks on MEMGs. False data injection attacks (FDIAs), a common type of cyber attack, could falsify energy arbitrage commands, thereby affecting the secondary frequency regulation and degrading the power quality of the MEMG. These attacks not only affect the normal operations of the MEMG but also reduce its economic profit. To address these issues, this paper proposes a novel deep reinforcement learning-based adaptive resilient control scheme to coordinate the energy conversion between electricity and hydrogen to eliminate the frequency deviation and maximize daily total revenue. Unlike traditional optimization techniques, the proposed deep reinforcement learning-based approach enables real-time adaption to dynamic and adversarial conditions, allowing the system to learn optimal strategies and improve resilience against FDIAs. Case studies with real-world datasets show that as the attack injection level increases from 5% to 20%, the proposed method maintains zero frequency deviation, with the total revenue decreasing by only 1.8%.
- Open Access
Co-Optimizing Battery Storage for Energy Arbitrage and Frequency Regulation in Real-Time Markets Using Deep Reinforcement Learning
Battery energy storage systems (BESSs) play a critical role in eliminating uncertainties associated with renewable energy generation, to maintain stability and improve flexibility of power networks. In this paper, a BESS is used to provide energy arbitrage (EA) and frequency regulation (FR) services simultaneously to maximize its total revenue within the physical constraints. The EA and FR actions are taken at different timescales. The multitimescale problem is formulated as two nested Markov decision process (MDP) submodels. The problem is a complex decision-making problem with enormous high-dimensional data and uncertainty (e.g., the price of the electricity). Therefore, a novel co-optimization scheme is proposed to handle the multitimescale problem, and also coordinate EA and FR services. A triplet deep deterministic policy gradient with exploration noise decay (TDD–ND) approach is used to obtain the optimal policy at each timescale. Simulations are conducted with real-time electricity prices and regulation signals data from the American PJM regulation market. The simulation results show that the proposed approach performs better than other studied policies in literature.
Open AccessCo-Optimizing Battery Storage for Energy Arbitrage and Frequency Regulation in Real-Time Markets Using Deep Reinforcement Learning
Battery energy storage systems (BESSs) play a critical role in eliminating uncertainties associated with renewable energy generation, to maintain stability and improve flexibility of power networks. In this paper, a BESS is used to provide energy arbitrage (EA) and frequency regulation (FR) services simultaneously to maximize its total revenue within the physical constraints. The EA and FR actions are taken at different timescales. The multitimescale problem is formulated as two nested Markov decision process (MDP) submodels. The problem is a complex decision-making problem with enormous high-dimensional data and uncertainty (e.g., the price of the electricity). Therefore, a novel co-optimization scheme is proposed to handle the multitimescale problem, and also coordinate EA and FR services. A triplet deep deterministic policy gradient with exploration noise decay (TDD–ND) approach is used to obtain the optimal policy at each timescale. Simulations are conducted with real-time electricity prices and regulation signals data from the American PJM regulation market. The simulation results show that the proposed approach performs better than other studied policies in literature.