Haoyang Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Haoyang Zhang has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
Koen Kok
4 shared publications- Nikolaos G. Paterakis
Eindhoven University of Technology
3 shared publications - Sen Zhan
Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
3 shared publications Georgios Tsaousoglou
2 shared publicationsNikolaos G. Paterakis
2 shared publications- Bin Jiang
Nanjing University of Aeronautics and Astronautics
1 shared publication
Latest Publications
- Open Access
- 30 June 2026
- Published by Elsevier in Electric Power Systems Research
- Vol. 262
A privacy-preserving distributed congestion management framework via implicit differentiation bilevel optimization
- 30 June 2026
- Published by Elsevier in Electric Power Systems Research
- Vol. 262
Open AccessA privacy-preserving distributed congestion management framework via implicit differentiation bilevel optimization
- Open Access
- 28 October 2025
- Published by Elsevier in Energy and AI
- Vol. 22
Taming deep reinforcement learning agents with pricing mechanism: Validation in power distribution systems
- 28 October 2025
- Published by Elsevier in Energy and AI
- Vol. 22
Open AccessTaming deep reinforcement learning agents with pricing mechanism: Validation in power distribution systems
- Open Access
- 30 March 2025
- Published by Elsevier in Applied Energy
- Vol. 389
Reliability assessment of multi-agent reinforcement learning algorithms for hybrid local electricity market simulation
- 30 March 2025
- Published by Elsevier in Applied Energy
- Vol. 389
Open AccessReliability assessment of multi-agent reinforcement learning algorithms for hybrid local electricity market simulation
- Open Access
- 26 March 2024
- Published by Elsevier in Applied Energy
- Vol. 363
Establishing a hierarchical local market structure using multi-cut Benders decomposition
- 26 March 2024
- Published by Elsevier in Applied Energy
- Vol. 363
Open AccessEstablishing a hierarchical local market structure using multi-cut Benders decomposition
- Open Access
- 12 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Designing Efficient Local Flexibility Markets in the Presence of Reinforcement-Learning Agents
Local Flexibility Markets (LFMs) are considered a promising framework towards resolving voltage and congestion issues of power distribution systems in an economically efficient manner. However, the need for location-specific flexibility services renders LFMs naturally imperfectly competitive and market efficiency is severely challenged by strategic participants that exploit their locally monopolistic power. Previous works have been considering either non-strategic participants, or strategic participants with perfect information (e.g. about the network characteristics etc) that can readily compute their payoffmaximizing bidding strategy. In this paper, we take on the problem of designing an efficient LFM in the more realistic case where market participants do not possess this information and, instead, learn to improve their bidding policies through experience. To that end, we develop a multi-agent reinforcement learning algorithm to model the participants' learning-to-bid process. In this framework, we first present two popular LFM pricing schemes (pay-as-bid and distribution locational marginal pricing) and expose that learning agents can discover ways to exploit them, resulting in severe dispatch inefficiency. We then present a gametheoretic pricing scheme that theoretically incentivizes truthful bidding and empirically demonstrate that this property improves the efficiency of the resulting dispatch also in the presence of learning agents. In particular, the proposed scheme is able to outperform the popular distribution locational marginal pricing (DLMP) scheme, in terms of efficiency, by a factor of 15 − 23%.
- 12 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessDesigning Efficient Local Flexibility Markets in the Presence of Reinforcement-Learning Agents
Local Flexibility Markets (LFMs) are considered a promising framework towards resolving voltage and congestion issues of power distribution systems in an economically efficient manner. However, the need for location-specific flexibility services renders LFMs naturally imperfectly competitive and market efficiency is severely challenged by strategic participants that exploit their locally monopolistic power. Previous works have been considering either non-strategic participants, or strategic participants with perfect information (e.g. about the network characteristics etc) that can readily compute their payoffmaximizing bidding strategy. In this paper, we take on the problem of designing an efficient LFM in the more realistic case where market participants do not possess this information and, instead, learn to improve their bidding policies through experience. To that end, we develop a multi-agent reinforcement learning algorithm to model the participants' learning-to-bid process. In this framework, we first present two popular LFM pricing schemes (pay-as-bid and distribution locational marginal pricing) and expose that learning agents can discover ways to exploit them, resulting in severe dispatch inefficiency. We then present a gametheoretic pricing scheme that theoretically incentivizes truthful bidding and empirically demonstrate that this property improves the efficiency of the resulting dispatch also in the presence of learning agents. In particular, the proposed scheme is able to outperform the popular distribution locational marginal pricing (DLMP) scheme, in terms of efficiency, by a factor of 15 − 23%.
- Open Access
- 30 October 2023
- Published by Czech Technical University in Prague - Central Library in Stavební obzor - Civil Engineering Journal
- Vol. 33 (3) , 383-396
RESEARCH ON UNBALANCED WEIGHING EXPERIMENT OF MULTI-POINT BRACED SWIVEL CABLE-STAYED BRIDGE
To guarantee the safety of the swivel process, the weighing experiment before the swivel is especially important. Based on this, this paper takes a twin-tower, double-cable prestressed concrete swivel cable-stayed bridge as the background and suggests a multi-point braced swivel weighing experiment involving the joint force of the arm-brace and the spherical hinge to solve problems such as a particular obstacle in the relying project's swivelling process. Firstly, the relevant weighing experiment formulas for various circumstances were theoretically derived. The field test results were then used to calculate the jacking force at the limit state during the jacking process, which was then substituted into the relevant formulae, and the relevant parameters of the weighing experiment were calculated. Finally, the counterweight is adjusted based on the weighing results to carry out the structural rotation. The angular velocity was stable during the swivelling process, and the structure was successfully swivelled. The successful practice of a multi-point braced swivel weighing experiment involving the joint force of the arm-brace, and the spherical hinge can provide a reference for the design and construction of similar bridges.
- 30 October 2023
- Published by Czech Technical University in Prague - Central Library in Stavební obzor - Civil Engineering Journal
- Vol. 33 (3) , 383-396
Open AccessRESEARCH ON UNBALANCED WEIGHING EXPERIMENT OF MULTI-POINT BRACED SWIVEL CABLE-STAYED BRIDGE
To guarantee the safety of the swivel process, the weighing experiment before the swivel is especially important. Based on this, this paper takes a twin-tower, double-cable prestressed concrete swivel cable-stayed bridge as the background and suggests a multi-point braced swivel weighing experiment involving the joint force of the arm-brace and the spherical hinge to solve problems such as a particular obstacle in the relying project's swivelling process. Firstly, the relevant weighing experiment formulas for various circumstances were theoretically derived. The field test results were then used to calculate the jacking force at the limit state during the jacking process, which was then substituted into the relevant formulae, and the relevant parameters of the weighing experiment were calculated. Finally, the counterweight is adjusted based on the weighing results to carry out the structural rotation. The angular velocity was stable during the swivelling process, and the structure was successfully swivelled. The successful practice of a multi-point braced swivel weighing experiment involving the joint force of the arm-brace, and the spherical hinge can provide a reference for the design and construction of similar bridges.
- 22 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
An Integrated Optimization Algorithm of Cutting Parameters and Scheduling for Flexible Job Shop
Environmental problems are becoming more and more serious. Manufacturing industry has the characteristics of high energy consumption and high pollution. Therefore, how to decrease the carbon emissions of the processing process is of great research significance. A hybrid particle swarm optimization algorithm is proposed for the integrated optimization of cutting parameters and flexible job shop scheduling problem that minimizes makespan and carbon emissions. The hybrid initialization method is proposed to ensure the diversity and quality of the initial population. An update method based on mutation operation, crossover operation and Jaya algorithm is designed to make particles jump out of local optimum and improve the search speed. The pareto sorting and crowding degree are used to evaluate the individuals in the population. The external memory pool is introduced to improve the population diversity and avoid premature. Finally, the effectiveness of the hybrid particle swarm optimization algorithm is verified by experiments.
- 22 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
An Integrated Optimization Algorithm of Cutting Parameters and Scheduling for Flexible Job Shop
Environmental problems are becoming more and more serious. Manufacturing industry has the characteristics of high energy consumption and high pollution. Therefore, how to decrease the carbon emissions of the processing process is of great research significance. A hybrid particle swarm optimization algorithm is proposed for the integrated optimization of cutting parameters and flexible job shop scheduling problem that minimizes makespan and carbon emissions. The hybrid initialization method is proposed to ensure the diversity and quality of the initial population. An update method based on mutation operation, crossover operation and Jaya algorithm is designed to make particles jump out of local optimum and improve the search speed. The pareto sorting and crowding degree are used to evaluate the individuals in the population. The external memory pool is introduced to improve the population diversity and avoid premature. Finally, the effectiveness of the hybrid particle swarm optimization algorithm is verified by experiments.
- 5 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3, 1-6
Studying the Impact of Smart Meter Placement on Low-Voltage Grid State Estimation
This paper comprehensively investigates the influence of smart meter allocation methods, considering sensors at grid buses and branches, on the performance of distribution system state estimation algorithms. Three algorithms are used, namely the Weighted Least Squares, the Extended Kalman Filter, and the Schweppe-type GM-estimator with the Huber psi-function. These are tested on a real low-voltage distribution grid with radial structure for multiple scenarios characterized by different penetration levels and types of measurements. Based on Monte Carlo simulations, different locations of sensors at buses and branches are considered for each scenario. An empirical study is carried out to assess the correlation of the placement of meters with the state estimation error. The results suggest that bus meters are most profitable at customers with the highest energy consumption. In addition, well distributed sensors at the grid branches based on a newly proposed ‘path search’ method appear to be the most effective.
- 5 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3, 1-6
Studying the Impact of Smart Meter Placement on Low-Voltage Grid State Estimation
This paper comprehensively investigates the influence of smart meter allocation methods, considering sensors at grid buses and branches, on the performance of distribution system state estimation algorithms. Three algorithms are used, namely the Weighted Least Squares, the Extended Kalman Filter, and the Schweppe-type GM-estimator with the Huber psi-function. These are tested on a real low-voltage distribution grid with radial structure for multiple scenarios characterized by different penetration levels and types of measurements. Based on Monte Carlo simulations, different locations of sensors at buses and branches are considered for each scenario. An empirical study is carried out to assess the correlation of the placement of meters with the state estimation error. The results suggest that bus meters are most profitable at customers with the highest energy consumption. In addition, well distributed sensors at the grid branches based on a newly proposed ‘path search’ method appear to be the most effective.