Change Detection Needs Change Information: Improving Deep 3-D Point Cloud Change Detection
- 29 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-10
Abstract
Change detection is an important task that rapidly identifies modified areas, particularly when multi-temporal data are concerned. In landscapes with a complex geometry (e.g., urban environment), vertical information is a very useful source of knowledge that highlights changes and classifies them into different categories. In this study, we focus on change segmentation using raw three-dimensional (3D) point clouds (PCs) directly to avoid any information loss due to the rasterization processes. While deep learning has recently proven its effectiveness for this particular task by encoding the information through Siamese networks, we investigate herein the idea of also using change information in the early steps of deep networks. To do this, we first propose to provide a Siamese KPConv state-of-the-art (SoTA) network with hand-crafted features, especially a change-related one, which improves the mean of the Intersection over Union (IoU) over the classes of change by 4.70%. Considering that a major improvement is obtained due to the change-related feature, we then propose three new architectures to address 3D PC change segmentation: OneConvFusion, Triplet KPConv, and Encoder Fusion SiamKPConv. All these networks consider the change information in the early steps and outperform the SoTA methods. In particular, Encoder Fusion SiamKPConv overtakes the SoTA approaches by more than 5% of the mean of the IoU over the classes of change, emphasizing the value of having the network focus on change information for the change detection task. The code is available at https://github.com/IdeGelis/torch-points3d-SiamKPConvVariants.Keywords
All Related Versions
Funding Information
- Centre national d'études spatiales
- GENCI (2022-AD011011754R2)
This publication has 43 references indexed in Scilit:
- 3D urban object change detection from aerial and terrestrial point clouds: A reviewInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Siamese KPConv: 3D multiple change detection from raw point clouds using deep learningISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Change detection of urban objects using 3D point clouds: A reviewISPRS Journal of Photogrammetry and Remote Sensing, 2023
- SUACDNet: Attentional change detection network based on siamese U-shaped structureInternational Journal of Applied Earth Observation and Geoinformation, 2021
- RETRACTED: SHREC 2021: 3D point cloud change detection for street scenesComputers & Graphics, 2021
- PCT: Point cloud transformerComputational Visual Media, 2021
- 3D change detection – Approaches and applicationsISPRS Journal of Photogrammetry and Remote Sensing, 2016
- Retreat rates, modalities and agents responsible for erosion along the coastal chalk cliffs of Upper Normandy: The contribution of terrestrial laser scanningGeomorphology, 2015
- Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z)ISPRS Journal of Photogrammetry and Remote Sensing, 2013
- Landslide inventories and their statistical propertiesEarth Surface Processes and Landforms, 2004