Jie Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jie Ma has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Jie Ma
Huazhong University of Science and Technology
4 shared publications - Pei An
Huazhong University of Science and Technology
4 shared publications - Jun Zhang
Huazhong University of Science and Technology
2 shared publications - Xiao Huang
China Ship Development and Design Center, Wuhan, China
2 shared publications - Xuzhong Hu
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology (HUST), Wuhan, Hubei, China
2 shared publications - Xuzhong Hu
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
2 shared publications
Latest Publications
- 14 November 2025
- Published by Elsevier in Pattern Recognition
- Vol. 172
Dual-domain homogeneous fusion with cross-modal mamba and progressive decoder for 3D object detection
- 14 November 2025
- Published by Elsevier in Pattern Recognition
- Vol. 172
Dual-domain homogeneous fusion with cross-modal mamba and progressive decoder for 3D object detection
- 21 August 2025
- Published by Springer Nature in Multimedia Systems
- Vol. 31 (5) , 1-17
Lidar-camera range-view fusion for 3D object detection in autonomous driving
- 21 August 2025
- Published by Springer Nature in Multimedia Systems
- Vol. 31 (5) , 1-17
Lidar-camera range-view fusion for 3D object detection in autonomous driving
- Open Access
- 19 December 2024
- Published by Springer Nature in Research Square
LiDAR-Camera Range-View fusion for 3D Object Detection in Autonomous Driving
In recent years, LiDAR-Camera fusion for 3D object detection has emerged as a research hotspot, owing to its superior performance compared to single-sensor approaches. However, the vast majority of methods adopt fusion in the point, voxel, or BEV domains. The distinct representations of LiDAR-Camera data lead to domain discrepancies and misalignment of their features, resulting in suboptimal detection accuracy and slow inference speeds. In contrast, this paper introduces a novel range-view fusion strategy, leveraging its unique advantages --- data homogeneity, accurate feature alignment, and high efficiency --- over other methods. We propose the Range-view Pyramidal Fusion network (RPfusion), in which two modules are specifically designed to address the inherent problems of range-view fusion: the significant scale variations of objects and the feature vanishment of occluded objects. First, Appearance Feature Fusion (AFF) module adaptively integrates complementary geometric and semantic information across different scales using dilated cross-attention. Next, a Range-Guided Cross-Layer Modulation (RGCLM) module is proposed to extract rich contextual information for comprehensive perception and enhance features of occluded targets. The output features can globally decorate raw point cloud, serving as input to any LiDAR-based detectors. Additionally, we propose RPfusion-Det, which employs a RoIfusion module with grid-wise self-attention for local fusion, leading to more precise box refinement. Extensive experiments on the KITTI and NuScenes datasets demonstrate that RPfusion can consistently enhance various detection models. Meanwhile, RPfusion-Det achieves superior accuracy while maintaining efficient inference.
- 19 December 2024
- Published by Springer Nature in Research Square
Open AccessLiDAR-Camera Range-View fusion for 3D Object Detection in Autonomous Driving
In recent years, LiDAR-Camera fusion for 3D object detection has emerged as a research hotspot, owing to its superior performance compared to single-sensor approaches. However, the vast majority of methods adopt fusion in the point, voxel, or BEV domains. The distinct representations of LiDAR-Camera data lead to domain discrepancies and misalignment of their features, resulting in suboptimal detection accuracy and slow inference speeds. In contrast, this paper introduces a novel range-view fusion strategy, leveraging its unique advantages --- data homogeneity, accurate feature alignment, and high efficiency --- over other methods. We propose the Range-view Pyramidal Fusion network (RPfusion), in which two modules are specifically designed to address the inherent problems of range-view fusion: the significant scale variations of objects and the feature vanishment of occluded objects. First, Appearance Feature Fusion (AFF) module adaptively integrates complementary geometric and semantic information across different scales using dilated cross-attention. Next, a Range-Guided Cross-Layer Modulation (RGCLM) module is proposed to extract rich contextual information for comprehensive perception and enhance features of occluded targets. The output features can globally decorate raw point cloud, serving as input to any LiDAR-based detectors. Additionally, we propose RPfusion-Det, which employs a RoIfusion module with grid-wise self-attention for local fusion, leading to more precise box refinement. Extensive experiments on the KITTI and NuScenes datasets demonstrate that RPfusion can consistently enhance various detection models. Meanwhile, RPfusion-Det achieves superior accuracy while maintaining efficient inference.
- 23 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (1) , 627-634
A Robust LiDAR-Camera Self-Calibration Via Rotation-Based Alignment and Multi-Level Cost Volume
Multi-sensor collaborative perception has been a significant trend in self-driving and robot navigation. The precondition for multi-sensor fusion is the accurate calibration between sensors. Traditional LiDAR-Camera calibrations rely on laborious manual operations. Several recent studies have demonstrated the advantages of convolutional neural networks regarding feature extraction capabilities. However, the vast modality discrepancy between RGB images and point clouds makes it difficult to explore corresponding features, remaining a challenge for LiDAR-Camera calibrations. In this letter, we propose a new robust online LiDAR-Camera self-calibration network (SCNet). To reduce the search dimensionality for feature matching, we exploit self-supervised learning to align RGB images with projected depth images in 2D pixel coordinates, thereby achieving pre-alignment of the roll angle. In addition, to generate more accurate initial similarity measures for RGB image pixels and possible corresponding projected depth image pixels, we propose a novel multi-level patch matching method that concatenates cost volume constructed from multi-level feature maps. Our method achieves a mean absolute calibration error of 0.724 cm in translation and 0.055 $^{\circ }$ in rotation in a single frame analysis with miscalibration magnitudes of up to $\pm$ 1.5 m and $\pm 20^{\circ }$ on the KITTI odometry dataset, which demonstrates the superiority of our method.
- 23 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (1) , 627-634
A Robust LiDAR-Camera Self-Calibration Via Rotation-Based Alignment and Multi-Level Cost Volume
Multi-sensor collaborative perception has been a significant trend in self-driving and robot navigation. The precondition for multi-sensor fusion is the accurate calibration between sensors. Traditional LiDAR-Camera calibrations rely on laborious manual operations. Several recent studies have demonstrated the advantages of convolutional neural networks regarding feature extraction capabilities. However, the vast modality discrepancy between RGB images and point clouds makes it difficult to explore corresponding features, remaining a challenge for LiDAR-Camera calibrations. In this letter, we propose a new robust online LiDAR-Camera self-calibration network (SCNet). To reduce the search dimensionality for feature matching, we exploit self-supervised learning to align RGB images with projected depth images in 2D pixel coordinates, thereby achieving pre-alignment of the roll angle. In addition, to generate more accurate initial similarity measures for RGB image pixels and possible corresponding projected depth image pixels, we propose a novel multi-level patch matching method that concatenates cost volume constructed from multi-level feature maps. Our method achieves a mean absolute calibration error of 0.724 cm in translation and 0.055 $^{\circ }$ in rotation in a single frame analysis with miscalibration magnitudes of up to $\pm$ 1.5 m and $\pm 20^{\circ }$ on the KITTI odometry dataset, which demonstrates the superiority of our method.
- 20 February 2023
- Published by Springer Nature in Neural Processing Letters
- Vol. 55 (5) , 6361-6375
Transformer-Based Cross-Modal Information Fusion Network for Semantic Segmentation
- 20 February 2023
- Published by Springer Nature in Neural Processing Letters
- Vol. 55 (5) , 6361-6375
Transformer-Based Cross-Modal Information Fusion Network for Semantic Segmentation