Tracking Deformable Surfaces That Undergo Topological Changes Using an RGB-D Camera
Authors:
- Aggeliki TsoliATAggeliki Tsoli
- Antonis A. ArgyrosAAAntonis A. Argyros
- 1 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 32, 333-341
Abstract
We present a method for 3D tracking of deformable surfaces with dynamic topology, for instance a paper that undergoes cutting or tearing. Existing template-based methods assume a template of fixed topology. Thus, they fail in tracking deformable objects that undergo topological changes. In our work, we employ a dynamic template (3D mesh) whose topology evolves based on the topological changes of the observed geometry. Our tracking framework deforms the defined template based on three types of constraints: (a) the surface of the template has to be registered to the 3D shape of the tracked surface, (b) the template deformation should respect feature (SIFT) correspondences between selected pairs of frames, and (c) the lengths of the template edges should be preserved. The latter constraint is relaxed when an edge is found to lie on a "geometric gap", that is, when a significant depth discontinuity is detected along this edge. The topology of the template is updated on the fly by removing overstretched edges that lie on a geometric gap. The proposed method has been evaluated quantitatively and qualitatively in both synthetic and real sequences of monocular RGB-D views of surfaces that undergo various types of topological changes. The obtained results show that our approach tracks effectively objects with evolving topology and outperforms state of the art methods in tracking accuracy.Keywords
This publication has 25 references indexed in Scilit:
- Shape-from-TemplateIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Adaptive tearing and cracking of thin sheetsACM Transactions on Graphics, 2014
- Online modeling for realtime facial animationACM Transactions on Graphics, 2013
- Adaptive fracture simulation of multi-layered thin platesACM Transactions on Graphics, 2013
- A Variational Approach to Video Registration with Subspace ConstraintsInternational Journal of Computer Vision, 2013
- Tracking surfaces with evolving topologyACM Transactions on Graphics, 2012
- Temporally coherent completion of dynamic shapesACM Transactions on Graphics, 2012
- A Survey on Shape CorrespondenceComputer Graphics Forum, 2011
- Fast Tracking of Deformable Objects in Depth and Colour Video2011
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004