Elham Yazdani Bejarbaneh
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Elham Yazdani Bejarbaneh has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Haiping Du
University of Wollongong
4 shared publications Ahmad Bagheri
Department of Dynamics, Control, and Vibration, Faculty of Mechanical Engineering, University of Guilan, Iran
3 shared publications- Behnam Yazdani Bejarbaneh
Department of Geotechnics and Transportation, Faculty of Civil Engineering, Universiti Teknologi Malaysia, Skudai, Malaysia
3 shared publications Salinda Buyamin
Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia
3 shared publicationsBinh Thai Pham
2 shared publications- Fazel Naghdy
University of Wollongong
2 shared publications
Latest Publications
- 2 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (12) , 22031-22044
A Robust Reinforcement Learning Framework for Platoon Control of Heterogeneous Vehicles Under Uncertain Dynamics
Cooperative driving of connected and automated vehicles (CAVs) is envisioned as a promising approach to improving fuel efficiency, safety, and traffic flow. However, achieving robust and efficient control in heterogeneous CAV platoons remains challenging, especially under uncertain dynamics and external disturbances. Most existing reinforcement learning (RL)-based platoon controllers often ignore model uncertainties or rely on centralized training, limiting their scalability and robustness in real-world applicability. To address these limitations, this study proposes a fully distributed, model-free RL framework integrated with a robust compensator for optimal platoon control of heterogeneous vehicles with unknown dynamics. The RL agent simultaneously learns the optimal control policy and estimates control-relevant dynamic parameters using only local input-output data, without requiring explicit vehicle models. These estimates are then used in real time to construct a disturbance-rejection input that ensures robust trajectory tracking. A distributed observer based on consensus theory is embedded within the hybrid controller to estimate leader-relative reference trajectories using only local neighbor information, eliminating the need for global communication. Theoretical analysis guarantees policy convergence and bounded tracking errors under dynamic uncertainties. The proposed method is experimentally validated using the high-fidelity Mixed Traffic Simulation (MiTaS) platform, combining the SUMO microscopic traffic simulator with MATLAB, demonstrating improved tracking, damping of traffic oscillations, and up to 15.8% fuel savings compared to recent RL-based methods.
- 2 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (12) , 22031-22044
A Robust Reinforcement Learning Framework for Platoon Control of Heterogeneous Vehicles Under Uncertain Dynamics
Cooperative driving of connected and automated vehicles (CAVs) is envisioned as a promising approach to improving fuel efficiency, safety, and traffic flow. However, achieving robust and efficient control in heterogeneous CAV platoons remains challenging, especially under uncertain dynamics and external disturbances. Most existing reinforcement learning (RL)-based platoon controllers often ignore model uncertainties or rely on centralized training, limiting their scalability and robustness in real-world applicability. To address these limitations, this study proposes a fully distributed, model-free RL framework integrated with a robust compensator for optimal platoon control of heterogeneous vehicles with unknown dynamics. The RL agent simultaneously learns the optimal control policy and estimates control-relevant dynamic parameters using only local input-output data, without requiring explicit vehicle models. These estimates are then used in real time to construct a disturbance-rejection input that ensures robust trajectory tracking. A distributed observer based on consensus theory is embedded within the hybrid controller to estimate leader-relative reference trajectories using only local neighbor information, eliminating the need for global communication. Theoretical analysis guarantees policy convergence and bounded tracking errors under dynamic uncertainties. The proposed method is experimentally validated using the high-fidelity Mixed Traffic Simulation (MiTaS) platform, combining the SUMO microscopic traffic simulator with MATLAB, demonstrating improved tracking, damping of traffic oscillations, and up to 15.8% fuel savings compared to recent RL-based methods.
- 23 April 2025
- Published by Springer Nature
- p. 638-650
Optimal Cooperative Intersection Control of Heterogeneous Vehicle Platoons with MiTraS
- 23 April 2025
- Published by Springer Nature
- p. 638-650
Optimal Cooperative Intersection Control of Heterogeneous Vehicle Platoons with MiTraS
- 28 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Cooperative Control of Vehicle Platoons with Unknown Dynamics using Neural Network-Enhanced Reinforcement Learning
This study proposes an optimal cooperative control framework for heterogeneous vehicle platoons using a neural network (NN)-based reinforcement learning (RL) algorithm in an identifier-critic-actor framework. Typically, determining the optimal control policy requires solving the Hamilton-Jacobi-Bellman (HJB) equation, but the presence of nonlinear terms within the HJB equation makes deriving analytical solutions challenging. While RL algorithms can overcome this issue, existing NN-based RL approaches are inherently complex as their update rules are derived from gradient descent optimization of the squared approximation of the HJB equation. This complexity makes their implementation challenging for nonlinear multi-vehicle systems with unknown dynamics. The proposed control strategy for platooning leverages an NN-based RL algorithm, where the update rules are directly derived from the negative gradient of a positive function that is mathematically equivalent to the HJB equation. Additionally, an NN-based identifier is incorporated into the platooning control design to dynamically estimate unknown vehicle dynamics in real time. The methodology is experimentally validated using the high-fidelity Mixed Traffic Simulator (MiTaS) co-simulation platform, which combines the Simulation of Urban Mobility (SUMO) microscopic traffic simulator with MATLAB environment. Simulations results demonstrate the efficacy of the learned strategy in achieving optimal leader-tracking performance.
- 28 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Cooperative Control of Vehicle Platoons with Unknown Dynamics using Neural Network-Enhanced Reinforcement Learning
This study proposes an optimal cooperative control framework for heterogeneous vehicle platoons using a neural network (NN)-based reinforcement learning (RL) algorithm in an identifier-critic-actor framework. Typically, determining the optimal control policy requires solving the Hamilton-Jacobi-Bellman (HJB) equation, but the presence of nonlinear terms within the HJB equation makes deriving analytical solutions challenging. While RL algorithms can overcome this issue, existing NN-based RL approaches are inherently complex as their update rules are derived from gradient descent optimization of the squared approximation of the HJB equation. This complexity makes their implementation challenging for nonlinear multi-vehicle systems with unknown dynamics. The proposed control strategy for platooning leverages an NN-based RL algorithm, where the update rules are directly derived from the negative gradient of a positive function that is mathematically equivalent to the HJB equation. Additionally, an NN-based identifier is incorporated into the platooning control design to dynamically estimate unknown vehicle dynamics in real time. The methodology is experimentally validated using the high-fidelity Mixed Traffic Simulator (MiTaS) co-simulation platform, which combines the Simulation of Urban Mobility (SUMO) microscopic traffic simulator with MATLAB environment. Simulations results demonstrate the efficacy of the learned strategy in achieving optimal leader-tracking performance.
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (11) , 15247-15272
Exploring Shared Perception and Control in Cooperative Vehicle-Intersection Systems: A Review
Road intersections will soon be congested with countless connected autonomous vehicles (CAVs) to meet a variety of transportation needs. In such an environment, CAVs will need to work together and coordinate with one another. Smart infrastructure should also be in place to enable CAVs to efficiently utilize shared intersection resources and carry out their mobility duties. The interaction among CAVs and between CAVs and infrastructure for efficient intersection management is facilitated by a key technology of intelligent transportation system (ITS), known as cooperative vehicle-intersection system (CVIS). Towards developing a better insight into this fast-developing technology, this study presents a thorough review of the state of the art in CVIS research in the context of three hierarchal layers of shared perception, intersection control, and vehicle control. To describe the workflow of cooperative perception systems, a systematic architecture of infrastructure-based perception supported by edge computing and multi-node multi-sensor fusion techniques is explored. Different shared perception methodologies, aiming at the perceptual fusion of CAVs and infrastructure to achieve comprehensive environmental perception are critically analyzed to identify the landscape of cooperative detection and tracking. With an emphasis on essential interaction between CAVs and infrastructure, various cooperative control strategies are then investigated for the co-design of crossing scheduling and motion control of multiple CAVs at intersections. The applications of CVIS in cooperative driving automation in terms of efficiency, safety, and sustainability are qualitatively analyzed. This paper concludes by identifying gaps and challenges in vehicle-intersection cooperation along with recommendations on future research directions.
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (11) , 15247-15272
Exploring Shared Perception and Control in Cooperative Vehicle-Intersection Systems: A Review
Road intersections will soon be congested with countless connected autonomous vehicles (CAVs) to meet a variety of transportation needs. In such an environment, CAVs will need to work together and coordinate with one another. Smart infrastructure should also be in place to enable CAVs to efficiently utilize shared intersection resources and carry out their mobility duties. The interaction among CAVs and between CAVs and infrastructure for efficient intersection management is facilitated by a key technology of intelligent transportation system (ITS), known as cooperative vehicle-intersection system (CVIS). Towards developing a better insight into this fast-developing technology, this study presents a thorough review of the state of the art in CVIS research in the context of three hierarchal layers of shared perception, intersection control, and vehicle control. To describe the workflow of cooperative perception systems, a systematic architecture of infrastructure-based perception supported by edge computing and multi-node multi-sensor fusion techniques is explored. Different shared perception methodologies, aiming at the perceptual fusion of CAVs and infrastructure to achieve comprehensive environmental perception are critically analyzed to identify the landscape of cooperative detection and tracking. With an emphasis on essential interaction between CAVs and infrastructure, various cooperative control strategies are then investigated for the co-design of crossing scheduling and motion control of multiple CAVs at intersections. The applications of CVIS in cooperative driving automation in terms of efficiency, safety, and sustainability are qualitatively analyzed. This paper concludes by identifying gaps and challenges in vehicle-intersection cooperation along with recommendations on future research directions.
- 10 January 2020
- Published by SAGE Publications in Transactions of the Institute of Measurement and Control
- Vol. 42 (8) , 1492-1510
Optimal design of adaptive and proportional integral derivative controllers using a novel hybrid particle swarm optimization algorithm
Controlling of a rotational inverted pendulum is considered as a challenging problem, mainly due to the system’s inherent nonlinear and unstable dynamics. In fact, the goal of this control is to maintain the pendulum vertically upward regardless of external disturbances. This paper aims to optimally design a model reference adaptive proportional integral derivative (PID) control for rotary inverted pendulum system based on a novel hybrid particle swarm optimization algorithm, combining sine cosine algorithm and levy flight distribution. Evaluation of the performance quality of the proposed adaptive controller is accomplished based on the stabilization and tracking control of rotary inverted pendulum system. In addition, two other PID controllers are designed to get a better understanding of the performance and robustness of the proposed controller. To make a complete comparison, the performance of the hybrid particle swarm optimization algorithm is examined against two other optimization techniques known as simple particle swarm optimization and whale optimization algorithm. Finally, the obtained simulation results demonstrate that the proposed optimal adaptive controller is superior to the other controllers, especially in terms of the transient response characteristics and the magnitude of control output signal.
- 10 January 2020
- Published by SAGE Publications in Transactions of the Institute of Measurement and Control
- Vol. 42 (8) , 1492-1510
Optimal design of adaptive and proportional integral derivative controllers using a novel hybrid particle swarm optimization algorithm
Controlling of a rotational inverted pendulum is considered as a challenging problem, mainly due to the system’s inherent nonlinear and unstable dynamics. In fact, the goal of this control is to maintain the pendulum vertically upward regardless of external disturbances. This paper aims to optimally design a model reference adaptive proportional integral derivative (PID) control for rotary inverted pendulum system based on a novel hybrid particle swarm optimization algorithm, combining sine cosine algorithm and levy flight distribution. Evaluation of the performance quality of the proposed adaptive controller is accomplished based on the stabilization and tracking control of rotary inverted pendulum system. In addition, two other PID controllers are designed to get a better understanding of the performance and robustness of the proposed controller. To make a complete comparison, the performance of the hybrid particle swarm optimization algorithm is examined against two other optimization techniques known as simple particle swarm optimization and whale optimization algorithm. Finally, the obtained simulation results demonstrate that the proposed optimal adaptive controller is superior to the other controllers, especially in terms of the transient response characteristics and the magnitude of control output signal.
- 1 December 2019
- Published by Elsevier in Applied Soft Computing
- Vol. 85
A new adjusting technique for PID type fuzzy logic controller using PSOSCALF optimization algorithm
- 1 December 2019
- Published by Elsevier in Applied Soft Computing
- Vol. 85
A new adjusting technique for PID type fuzzy logic controller using PSOSCALF optimization algorithm
- 1 July 2018
- Published by Allerton Press in Automatic Control and Computer Sciences
- Vol. 52 (4) , 256-267
Optimization of Model Reference Adaptive Controller for the Inverted Pendulum System Using CCPSO and DE Algorithms
The main aim of this paper is to propose two variants of bio-inspired algorithm, Constriction Coefficient Particle Swarm Optimization (CCPSO) and Differential Evolution (DE), which determine optimal...
- 1 July 2018
- Published by Allerton Press in Automatic Control and Computer Sciences
- Vol. 52 (4) , 256-267
Optimization of Model Reference Adaptive Controller for the Inverted Pendulum System Using CCPSO and DE Algorithms
The main aim of this paper is to propose two variants of bio-inspired algorithm, Constriction Coefficient Particle Swarm Optimization (CCPSO) and Differential Evolution (DE), which determine optimal...