Embedding 3D models in offline physical environments
- 1 July 2020
- journal article
- research article
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 31 (4-5)
Abstract
This article introduces a novel approach for embedding 3D models in offline physical environments using quick response (QR) codes. Unlike conventional methods, we consider settings where 3D models cannot be retrieved from a remote server. Our method involves generating octree models from voxelized 3D models and storing them in QR codes using a space‐efficient data structure. This allows storing 3D models that are both intelligible and purposeful on standard QR codes while addressing the major storage constraint that is present in offline situations. Furthermore, we explore 3D convolutional neural networks (CNN) and autoencoders (AE) to compress 3D models with high resolutions where using octrees alone does not suffice. To the best of our knowledge, our AE network is the first to employ octrees to further compress its encoded data. Through user‐friendly desktop and mobile applications, we allow users to encode, decode and visualize 3D models in augmented reality (AR) using QR codes, thus experiment with our methods. The proposed approach enables unique applications and future research in ubiquitous computing, 3D data compression and transmission, 3D AEs, AR and Virtual Reality, low‐cost autonomous robots, and 3D printing.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFC1521104, 2018YFF0300903)
- National Natural Science Foundation of China (61572316, 61872241)
- Hong Kong Polytechnic University (P0030419, P0030929)
This publication has 21 references indexed in Scilit:
- VoxNet: A 3D Convolutional Neural Network for real-time object recognition2015
- Analyzing the Use of Quick Response Codes in the Wild2015
- Octree-based fusion for realtime 3D reconstructionGraphical Models, 2013
- OctoMap: an efficient probabilistic 3D mapping framework based on octreesAutonomous Robots, 2013
- Unsynchronized 4D Barcodes2007
- Real-World Interaction with Camera Phones2005
- Simplification and repair of polygonal models using volumetric techniquesIEEE Transactions on Visualization and Computer Graphics, 2003
- Octree-R: an adaptive octree for efficient ray tracingIEEE Transactions on Visualization and Computer Graphics, 1995
- A Simple Method for Color Quantization: Octree Quantization1988
- Data compression via textual substitutionJournal of the ACM, 1982