DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptation
Authors:
- 26 February 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2154-2163
Abstract
The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from partial image inputs. Despite numerous existing methods, many face challenges such as inaccurately predicting object shapes and misclassifying object boundaries. To address these issues, we propose DepthSSC, an advanced method for semantic scene completion using only monocular cameras. DepthSSC integrates the Spatial Transformation Graph Fusion (ST-GF) module with Geometric-Aware Voxelization (GAV), enabling dynamic adjustment of voxel resolution to accommodate the geometric complexity of 3D space. This ensures precise alignment between spatial and depth information, effectively mitigating issues such as object boundary distortion and incorrect depth perception found in previous methods. Evaluations on the SemanticKITTI and SSCBench-KITTI-360 dataset demonstrate that DepthSSC not only captures intricate 3D structural details effectively but also achieves state-of-the- art performance.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- VoxFormer: Sparse Voxel Transformer for Camera-Based 3D Semantic Scene Completion2023
- BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers2022
- MonoScene: Monocular 3D Semantic Scene Completion2022
- LMSCNet: Lightweight Multiscale 3D Semantic Completion2020
- Anisotropic Convolutional Networks for 3D Semantic Scene Completion2020
- RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion2019
- Efficient Semantic Scene Completion Network with Spatial Group Convolution2018
- Semantic Scene Completion from a Single Depth Image2017
- A survey of the marching cubes algorithmComputers & Graphics, 2006
- Comparing images using the Hausdorff distanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993