YWYunlong Wang

Yunlong Wang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Yunlong Wang has a total of 25 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Top-Down Attention-Based Mechanisms for Interpretable Autonomous Driving

    by Zheng Fu, Kun Jiang, Yuhang Xu, Yunlong Wang, Tuopu Wen, Hao Gao, Zhihua Zhong, Diange Yang

    Despite the remarkable advancements in autonomous driving, the challenge persists in achieving interpretable action decision-making, primarily owing to the intricate and ambiguous relationship between detected agents and driving intention. In this study, we introduce an interpretable action prediction model, denoted as the Prediction-Driven Attention Network (PDANet), designed to undertake action decisions and provide corresponding interpretations cohesively. The PDANet is inspired by the perceptual mechanisms inherent in human drivers, who allocate attention according to their driving intentions. Specifically, we elaborate a prediction module to generate vehicle prospective trajectories to characterize driving intentions. Subsequently, the features of this predicted trajectory are utilized to modulate the attention distribution among agents through the top-down attention module, yielding an attention map. Finally, two distinct task tokens are applied to aggregate agent features and generate the final output according to the derived attention map. Extensive experiments conducted on the publicly available BDD-OIA and nu-AR datasets demonstrate that our proposed method outperforms all prior works in terms of both action prediction and behavior interpretation tasks. Remarkably, our method attains a noteworthy enhancement in the behavior interpretation task, surpassing the previous state-of-the-art by a substantial margin of +10.8% in terms of F1-score on the nu-AR dataset. We also validate our algorithm on Carla Town05 long in a closed-loop decision-making scenario, highlighting the generality and robustness of our approach. Furthermore, qualitative results show that the agents selected by our model are more closely aligned with human cognitive processes.


  • A Survey on Monocular Re-Localization: From the Perspective of Scene Map Representation

    by Jinyu Miao, Kun Jiang, Tuopu Wen, Yunlong Wang, Peijin Jia, Benny Wijaya, Xuhe Zhao, Qian Cheng, Zhongyang Xiao, Jin Huang, et al.

    Monocular Re-Localization (MRL) is an essential component in autonomous applications, estimating 6 degree-of-freedom ego poses w.r.t. the scene map using monocular images. Over the past few decades, there has been notable advancement in the field of MRL techniques. Several works have achieved remarkable success in terms of both the accuracy and reliability of localization. In MRL, scene maps are represented in diverse forms, and they dictate the functionality and efficacy of MRL methods. However, to the best of our knowledge, existing surveys do not provide systematic reviews about the correlation between MRL solutions and their used scene map representation. This survey fills the gap by comprehensively reviewing MRL methods from such a perspective, promoting further research. 1) We commence by delving into the problem definition of MRL, exploring current challenges, and comparing ours with existing surveys. 2) MRL methods are categorized and reviewed into five classes based on the representation forms of the utilized map, i.e., geo-tagged frames, visual landmarks, point clouds, vectorized semantic maps, and neural network-based maps. 3) To quantitatively and fairly compare MRL methods using different maps, we introduce some public datasets and evaluate the performances of several advanced MRL approaches. The strengths and shortcomings of MRL methods using various maps are analyzed. 4) Finally, we introduce some topics of interest in this field and provide our individual viewpoints. This survey can serve as a valuable resource for MRL, and a summary of this survey is accessible to the community at: github.com/jinyummiao/map-in-mono-reloc


  • Open Access

    Multi-Session High-Definition Map-Monitoring System for Map Update

    by Benny Wijaya, Mengmeng Yang, Tuopu Wen, Kun Jiang, Yunlong Wang, Zheng Fu, Xuewei Tang, Dennis Octovan Sigomo, Jinyu Miao, Diange Yang

    This research paper employed a multi-session framework to present an innovative approach to map monitoring within the domain of high-definition (HD) maps. The proposed methodology uses a machine learning algorithm to derive a confidence level for the detection of specific map elements in each frame and tracks the position of the element in subsequent frames. This creates a virtual belief system, which indicates the existence of the element on the HD map. To confirm the existence of the element and ensure the credibility of the map data, a reconstruction and matching technique was implemented. The notion of an expected observation area is also introduced by strategically limiting the vehicle’s observation range, thereby bolstering the detection confidence of the observed map elements. Furthermore, we leveraged data from multiple vehicles to determine the necessity for updates within specific areas, ensuring the accuracy and dependability of the map information. The validity and practicality of our approach were substantiated by real experimental data, and the monitoring accuracy exceeded 90%.


  • Poses as Queries: End-to-End Image-to-LiDAR Map Localization With Transformers

    by Jinyu Miao, Kun Jiang, Yunlong Wang, Tuopu Wen, Zhongyang Xiao, Zheng Fu, Mengmeng Yang, Maolin Liu, Jin Huang, Zhihua Zhong, et al.

    High-precision vehicle localization with commercial setups is a crucial technique for high-level autonomous driving tasks. As a newly emerged approach, monocular localization in LiDAR map achieves promising balance between cost and accuracy, but estimating pose by finding correspondences between such cross-modal sensor data is challenging, thereby damaging the localization accuracy. In this letter, we address the problem by proposing a novel Transformer-based neural network to register 2D images into 3D LiDAR map in an end-to-end manner. We first implicitly represent poses as high-dimensional feature vectors called pose queries and gradually optimize poses by interacting with the retrieved relevant information from cross-modal features using attention mechanism in a proposed POse Estimator Transformer (POET) module. Moreover, we apply a multiple hypotheses aggregation method that estimates the final poses by performing parallel optimization on multiple randomly initialized pose queries to reduce the network uncertainty. Comprehensive analysis and experimental results on public benchmarks conclude that the proposed image-to-LiDAR map localization network could achieve state-of-the-art performances in challenging cross-modal localization tasks.


  • SGFNet: Segmentation Guided Fusion Network for 3D Object Detection

    by Yunlong Wang, Kun Jiang, Tuopu Wen, Xinyu Jiao, Benny Wijaya, Jinyu Miao, Yining Shi, Zheng Fu, Mengmeng Yang, Diange Yang

    The self-driving application requires accurate 3D object detection as it is essential in several tasks, such as path and motion planning. However, up until this point, fusion-based detectors with cameras and LiDAR sensors have always been inferior to LiDAR-only detectors. This can be attributed to the dual scene representation problem caused by the differentiated modality of LiDAR points and images. Moreover, the projection of the image pixels is not guaranteed to reach its point cloud counterparts due to the sparsity of the points, losing image content in the fusion process. Bearing these in mind, we propose Segmentation Guided Fusion Network (SGFNet), an efficient multi-sensor fusion-based 3D object detector. It first separates feature extractions of images and points with unified high-dimensional feature representation through the novel-proposed auxiliary foreground segmentation head, and then projects hierarchical feature maps instead of the raw image pixels onto points to obtain the unified feature map, achieving consistent data modality. Such image feature maps are with several spatial resolutions to keep more image content during the projection process. Finally, the unified feature map is fed into a fusion-based region proposal module and bounding box regression head to generate accurate 3D bounding boxes. Extensive experiments conducted on KITTI and nuScenes datasets demonstrate that SGFNet achieves competitive performance on fusion-based 3D object detection tasks and reports a novel state-of-the-art in terms of 3D average precision metric.