Deep learning based computer vision under the prism of 3D point clouds: a systematic review
Open Access
- 29 January 2024
- journal article
- review article
- Published by Springer Nature in The Visual Computer
- Vol. 40 (11) , 8287-8329
Abstract
Point clouds consist of 3D data points and are among the most considerable data formats for 3D representations. Their popularity is due to their broad application areas, such as robotics and autonomous driving, and their employment in basic 3D vision tasks such as segmentation, classification, and detection. However, processing point clouds is challenging compared to other visual forms such as images, mainly due to their unstructured nature. Deep learning (DL) has been established as a powerful tool for data processing, reporting remarkable performance enhancements compared to traditional methods for all basic 2D vision tasks. However new challenges are emerging when it comes to processing unstructured 3D point clouds. This work aims to guide future research by providing a systematic review of DL on 3D point clouds, holistically covering all 3D vision tasks. 3D technologies of point cloud formation are reviewed and compared to each other. The application of DL methods for point cloud processing is discussed, and state-of-the-art models’ performances are compared focusing on challenges and solutions. Moreover, in this work the most popular 3D point cloud benchmark datasets are summarized based on their task-oriented applications, aiming to highlight existing constraints and to comparatively evaluate them. Future research directions and upcoming trends are also highlighted.Keywords
Funding Information
- International Hellenic University
This publication has 282 references indexed in Scilit:
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- SVM-Based Classification of Segmented Airborne LiDAR Point Clouds in Urban AreasRemote Sensing, 2013
- OctoMap: an efficient probabilistic 3D mapping framework based on octreesAutonomous Robots, 2013
- Image meldingACM Transactions on Graphics, 2012
- Automated sparse 3D point cloud generation of infrastructure using its distinctive visual featuresAdvanced Engineering Informatics, 2011
- Digital Photogrammetric Camera Evaluation Generation of Digital Elevation ModelsPhotogrammetrie - Fernerkundung - Geoinformation, 2010
- Interferometric Potential of High Resolution Spaceborne SARPhotogrammetrie - Fernerkundung - Geoinformation, 2009
- Image‐Based Surface CompressionComputer Graphics Forum, 2008
- Introduction to Modern Photogrammetry.The Photogrammetric Record, 2003
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992