Tranquil Clouds: Neural Networks for Learning Temporally Coherent Features in Point Clouds
Preprint
Abstract
Point clouds, as a form of Lagrangian representation, allow for powerful and flexible applications in a large number of computational disciplines. We propose a novel deep-learning method to learn stable and temporally coherent feature spaces for points clouds that change over time. We identify a set of inherent problems with these approaches: without knowledge of the time dimension, the inferred solutions can exhibit strong flickering, and easy solutions to suppress this flickering can result in undesirable local minima that manifest themselves as halo structures. We propose a novel temporal loss function that takes into account higher time derivatives of the point positions, and encourages mingling, i.e., to prevent the aforementioned halos. We combine these techniques in a super-resolution method with a truncation approach to flexibly adapt the size of the generated positions. We show that our method works for large, deforming point sets from different sources to demonstrate the flexibility of our approach.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- 3D Recurrent Neural Networks with Context Fusion for Point Cloud Semantic Segmentation2018
- PPFNet: Global Context Aware Local Features for Robust 3D Point Matching2018
- SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation2018
- Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs2018
- PU-Net: Point Cloud Upsampling Network2018
- SPLATNet: Sparse Lattice Networks for Point Cloud Processing2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation2018
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation2017
- A Point Set Generation Network for 3D Object Reconstruction from a Single Image2017