Yiyue Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Yiyue Zhao has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Cailin Lei
Chongqing Jiaotong University
2 shared publications - Qijun Chen
Tongji University
2 shared publications - Yu Shen
Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, Shanghai, China
2 shared publications - Yuchuan Du
School of Transportation Engineering and the Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai, China
2 shared publications - Chen Chai
Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, Shanghai, China
1 shared publication Wenxuan Fan
College of Transportation Engineering Tongji University 201804 Shanghai China
1 shared publication
Latest Publications
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (11) , 12716-12725
Improving Autonomous Vehicle Visual Perception by Fusing Human Gaze and Machine Vision
With high-definition sensors and sophisticated machine vision algorithms, the visual perception capability of autonomous vehicle (AV) has largely advanced. However, the visual perception performance of AVs may still be unstable in complex traffic environment. To improve the robustness and capability of risk detection of AV visual perception system, this work proposes a framework to fuse human gaze and the object detection results from vehicle vision based on the Laplacian Pyramid algorithm. We evaluate the proposed method on a level-2 AV to perceive the interactive vehicles at unsignalized intersections. Using Extended Kalman Filter, the trajectory of the human driversgaze and the anchor boxes from AV object detection are fused. Results reveal that with human-vehicle visual fusion, the actual trajectory of interactive vehicles can be predicted more accurately than separately using human gaze or object detection algorithm. The findings show that human-vehicle visual fusion improves the perception accuracy and robustness of interactive objects in complex traffic environment. The method has the potential to enhance the attention mechanism of AV vision.
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (11) , 12716-12725
Improving Autonomous Vehicle Visual Perception by Fusing Human Gaze and Machine Vision
With high-definition sensors and sophisticated machine vision algorithms, the visual perception capability of autonomous vehicle (AV) has largely advanced. However, the visual perception performance of AVs may still be unstable in complex traffic environment. To improve the robustness and capability of risk detection of AV visual perception system, this work proposes a framework to fuse human gaze and the object detection results from vehicle vision based on the Laplacian Pyramid algorithm. We evaluate the proposed method on a level-2 AV to perceive the interactive vehicles at unsignalized intersections. Using Extended Kalman Filter, the trajectory of the human driversgaze and the anchor boxes from AV object detection are fused. Results reveal that with human-vehicle visual fusion, the actual trajectory of interactive vehicles can be predicted more accurately than separately using human gaze or object detection algorithm. The findings show that human-vehicle visual fusion improves the perception accuracy and robustness of interactive objects in complex traffic environment. The method has the potential to enhance the attention mechanism of AV vision.
- 15 February 2023
- Published by Springer Nature
- p. 646-662
Human-Vehicle Cooperative Visual Perception for Autonomous Driving Under Complex Traffic Environments
- 15 February 2023
- Published by Springer Nature
- p. 646-662
Human-Vehicle Cooperative Visual Perception for Autonomous Driving Under Complex Traffic Environments
- Open Access
Efficient textual explanations for complex road and traffic scenarios based on semantic segmentation
The complex driving environment brings great challenges to the visual perception of autonomous vehicles. It's essential to extract clear and explainable information from the complex road and traffic scenarios and offer clues to decision and control. However, the previous scene explanation had been implemented as a separate model. The black box model makes it difficult to interpret the driving environment. It cannot detect comprehensive textual information and requires a high computational load and time consumption. Thus, this study proposed a comprehensive and efficient textual explanation model. From 336k video frames of the driving environment, critical images of complex road and traffic scenarios were selected into a dataset. Through transfer learning, this study established an accurate and efficient segmentation model to obtain the critical traffic elements in the environment. Based on the XGBoost algorithm, a comprehensive model was developed. The model provided textual information about states of traffic elements, the motion of conflict objects, and scenario complexity. The approach was verified on the real-world road. It improved the perception accuracy of critical traffic elements to 78.8%. The time consumption reached 13 minutes for each epoch, which was 11.5 times more efficient than the pre-trained network. The textual information analyzed from the model was also accordant with reality. The findings offer clear and explainable information about the complex driving environment, which lays a foundation for subsequent decision and control. It can improve the visual perception ability and enrich the prior knowledge and judgments of complex traffic situations.
Open AccessEfficient textual explanations for complex road and traffic scenarios based on semantic segmentation
The complex driving environment brings great challenges to the visual perception of autonomous vehicles. It's essential to extract clear and explainable information from the complex road and traffic scenarios and offer clues to decision and control. However, the previous scene explanation had been implemented as a separate model. The black box model makes it difficult to interpret the driving environment. It cannot detect comprehensive textual information and requires a high computational load and time consumption. Thus, this study proposed a comprehensive and efficient textual explanation model. From 336k video frames of the driving environment, critical images of complex road and traffic scenarios were selected into a dataset. Through transfer learning, this study established an accurate and efficient segmentation model to obtain the critical traffic elements in the environment. Based on the XGBoost algorithm, a comprehensive model was developed. The model provided textual information about states of traffic elements, the motion of conflict objects, and scenario complexity. The approach was verified on the real-world road. It improved the perception accuracy of critical traffic elements to 78.8%. The time consumption reached 13 minutes for each epoch, which was 11.5 times more efficient than the pre-trained network. The textual information analyzed from the model was also accordant with reality. The findings offer clear and explainable information about the complex driving environment, which lays a foundation for subsequent decision and control. It can improve the visual perception ability and enrich the prior knowledge and judgments of complex traffic situations.