Semantic-MoSeg: Semantics-Assisted Moving-Obstacle Segmentation in Bird-Eye-View for Autonomous Driving
- 3 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (7) , 9251-9262
Abstract
Bird-eye-view (BEV) perception for autonomous driving has become popular in recent years. Among various BEV perception tasks, moving-obstacle segmentation is very important, since it can provide necessary information for downstream tasks, such as motion planning and decision making, in dynamic traffic environments. Many existing methods segment moving obstacles with LiDAR point clouds. The point-wise segmentation results can be easily projected into BEV since point clouds are 3-D data. However, these methods could not produce dense 2-D BEV segmentation maps, because LiDAR point clouds are usually sparse. Moreover, 3-D LiDARs are still expensive to vehicles. To provide a solution to these issues, this paper proposes a semantics-assisted moving-obstacle segmentation network using only low-cost visual cameras to produce segmentation results in dense 2-D BEV maps. Our network takes as input visual images from six surrounding cameras as well as the corresponding semantic segmentation maps at the current and previous moments, and directly outputs the BEV map for the current moment. We also propose a movable-obstacle segmentation auxiliary task to provide semantic information to further benefit moving-obstacle segmentation. Extensive experimental results on the public nuScenes and Lyft datasets demonstrate the effectiveness and superiority of our network.Keywords
Funding Information
- Basic and Applied Basic Research Foundation of Guangdong Province (2022A1515010116)
- City University of Hong Kong (9610675)
This publication has 50 references indexed in Scilit:
- PEAFusion: Parameter-efficient Adaptation for RGB-Thermal fusion-based semantic segmentationInformation Fusion, 2025
- BASeg: Boundary aware semantic segmentation for autonomous drivingNeural Networks, 2022
- BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers2022
- Review the state-of-the-art technologies of semantic segmentation based on deep learningNeurocomputing, 2022
- The Emerging Field of Graph Signal Processing for Moving Object Segmentation2021
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D2020
- Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations2020
- MotionRFCN: Motion Segmentation Using Consecutive Dense Depth Maps2019
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Inverse perspective mapping simplifies optical flow computation and obstacle detectionBiological Cybernetics, 1991