Donghao Zhou
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Donghao Zhou has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Jian Sun
Tongji University
2 shared publications - Jiaqi Liu
University of North Carolina at Chapel Hill
1 shared publication - Peng Hang
Tongji University
1 shared publication - Xiaohui Zhang
Department of Traffic Engineering and Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai, China
1 shared publication - Ying Ni
Tongji University
1 shared publication Zian Ma
The Key Laboratory of Road and Traffic Engineering Ministry of Education Tongji University Shanghai China
1 shared publication
Latest Publications
- 13 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 9 (1) , 827-838
Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework With Driving Priors and Coordination Awareness
The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving environments. AVs are expected to have human-like driving behavior to seamlessly integrate into human-dominated traffic systems. To address this issue, we propose a reinforcement learning framework that considers driving priors and Social Coordination Awareness (SCA) to optimize the behavior of AVs. The framework integrates a driving prior learning (DPL) model based on a variational autoencoder to infer the driver's driving priors from human drivers' trajectories. A policy network based on a multi-head attention mechanism is designed to effectively capture the interactive dependencies between AVs and other traffic participants to improve decision-making quality. The introduction of SCA into the autonomous driving decision-making system, and the use of Coordination Tendency (CT) to quantify the willingness of AVs to coordinate the traffic system is explored. The unsignalized intersection serves as a representative experimental scenario. Simulation results show that the proposed framework can not only improve the decision-making quality of AVs but also motivate them to produce social behaviors, with potential benefits for the safety and traffic efficiency of the entire transportation system.
- 13 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 9 (1) , 827-838
Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework With Driving Priors and Coordination Awareness
The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving environments. AVs are expected to have human-like driving behavior to seamlessly integrate into human-dominated traffic systems. To address this issue, we propose a reinforcement learning framework that considers driving priors and Social Coordination Awareness (SCA) to optimize the behavior of AVs. The framework integrates a driving prior learning (DPL) model based on a variational autoencoder to infer the driver's driving priors from human drivers' trajectories. A policy network based on a multi-head attention mechanism is designed to effectively capture the interactive dependencies between AVs and other traffic participants to improve decision-making quality. The introduction of SCA into the autonomous driving decision-making system, and the use of Coordination Tendency (CT) to quantify the willingness of AVs to coordinate the traffic system is explored. The unsignalized intersection serves as a representative experimental scenario. Simulation results show that the proposed framework can not only improve the decision-making quality of AVs but also motivate them to produce social behaviors, with potential benefits for the safety and traffic efficiency of the entire transportation system.
- Open Access
- 22 April 2022
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 16 (8) , 1058-1073
Autonomous vehicles’ intended cooperative motion planning for unprotected turning at intersections
Turning behaviour is one of the most challenging driving manoeuvres that take place at intersections. Autonomous vehicles (AVs) are often overly conservative in these scenarios as they compromised to others’ behaviour to realize behavioural consistency. This paper proposes an intended cooperative motion planning (ICMP) that can actively predict the intentions of interacting participants. This helps achieve socially compliant cooperation and enables each vehicle to converge upon a set of consistent behaviours. The ICMP framework divides the integrated driving process into two related modules: prediction and planning. These modules are integrated using the mechanism of intended cooperation, which first introduces the criteria for a cooperative response and then maps them in the motion planning space. The prediction module applies a Gaussian mixture model to learn human drivers’ behaviour to determine conflict points, which helps to narrow down the solution spaces. In the planning module, paths are represented by quartic Bézier curves and speed is modelled as a polynomial function. Optimizations can then be used that maximize the efficiency and smoothness for path planning, and comfort and efficiency for speed planning. The test results show that ICMP‐based AVs had consistent interactions with other vehicles. Moreover, when compared with a potential field‐based method, the ICMP‐based method had better performance in terms of safety, comfort and efficiency, especially when interacting with multiple oncoming vehicles.
- 22 April 2022
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 16 (8) , 1058-1073
Open AccessAutonomous vehicles’ intended cooperative motion planning for unprotected turning at intersections
Turning behaviour is one of the most challenging driving manoeuvres that take place at intersections. Autonomous vehicles (AVs) are often overly conservative in these scenarios as they compromised to others’ behaviour to realize behavioural consistency. This paper proposes an intended cooperative motion planning (ICMP) that can actively predict the intentions of interacting participants. This helps achieve socially compliant cooperation and enables each vehicle to converge upon a set of consistent behaviours. The ICMP framework divides the integrated driving process into two related modules: prediction and planning. These modules are integrated using the mechanism of intended cooperation, which first introduces the criteria for a cooperative response and then maps them in the motion planning space. The prediction module applies a Gaussian mixture model to learn human drivers’ behaviour to determine conflict points, which helps to narrow down the solution spaces. In the planning module, paths are represented by quartic Bézier curves and speed is modelled as a polynomial function. Optimizations can then be used that maximize the efficiency and smoothness for path planning, and comfort and efficiency for speed planning. The test results show that ICMP‐based AVs had consistent interactions with other vehicles. Moreover, when compared with a potential field‐based method, the ICMP‐based method had better performance in terms of safety, comfort and efficiency, especially when interacting with multiple oncoming vehicles.