3DCapture: 3D Reconstruction for a Smartphone
Authors:
- Oleg MuratovOMOleg Muratov
- Yury SlynkoYSYury Slynko
- Vitaly ChernovVCVitaly Chernov
- Maria LyubimtsevaMLMaria Lyubimtseva
- Artem ShamsuarovASArtem Shamsuarov
- Victor BuchaVBVictor Bucha
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 893-900
Abstract
We propose a method of reconstruction of 3D representation (a mesh with a texture) of an object on a smartphone with a monocular camera. The reconstruction consists of two parts - real-time scanning around the object and postprocessing. At the scanning stage IMU sensors data are acquired along with tracks of features in video. A special care is taken to comply with 360 scan requirement. All these data are used to build a camera trajectory using bundle adjustment techniques after scanning is completed. This trajectory is used in calculation of depth maps, which then are used to construct a polygonal mesh with overlaid textures. The proposed method ensures tracking at 30 fps on a modern smartphone while the post-processing part is completed within 1 minute using an OpenCL compatible mobile GPU. In addition, we show that with a few modifications this algorithm can be adopted for human face reconstruction.Keywords
This publication has 10 references indexed in Scilit:
- Turning Mobile Phones into 3D Scanners2014
- Live Metric 3D Reconstruction on Mobile Phones2013
- User friendly SLAM initialization2013
- Simultaneous 3D tracking and reconstruction on a mobile phone2013
- Markerless 3D facial motion capture system2012
- BRISK: Binary Robust invariant scalable keypoints2011
- Parallel Tracking and Mapping for Small AR Workspaces2007
- Seamless Mosaicing of Image-Based Texture Maps2007
- Fusing points and lines for high performance tracking2005
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004