VPModel: High-Fidelity Product Simulation in a Virtual-Physical Environment
- 12 August 2019
- journal article
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 25 (11) , 3083-3093
Abstract
In the development of a new product, the design team must describe the expected effects of the final products to potential users and stakeholders. However, existing prototyping tools can only present a product imperfectly, due to limitations at different levels. Specifically, the physical product model, which may be the product of 3D printing, could lack a visual interface; the presentation of the product through modeling software such as Rhinoceros 3D does not provide good realistic tactile perception; or the interface platforms, such as Axure RP, used to display the interactive effects differ from those to be used in the actual operation. Thus, we present the VPModel, a high-fidelity prototyping tool, able to integrate multiple prototyping methods simultaneously. It combines a touchable 3D-printed product model (3DPM) and a corresponding visualized virtual model, and the interactive interfaces are rendered synchronously in a mixed-reality device. Through the tangible, visual, and interactive demonstration, designers and normal users can each obtain a similar experience to the experience of the finished product. Furthermore, the VPModel also enhances design practices by enabling comparisons between modular models. However, the implementation of this system is a challenging task, which subsumes several fundamental problems as sub-tasks: object detection, real-time matching, hand-gesture detection and action recognition. To achieve the expected goals of the VPModel, this system uses physical hardware (a Microsoft MR HoloLens headset, a Leap Motion Controller, and a 3D printer) and existing machine learning algorithms. To evaluate our VPModel, we report the user experience of 16 participants, evaluated using a closed-ended questionnaire survey, a quantitative analysis of task performance, and a qualitative analysis of open-ended interviews. The results show a significant improvement in realism and enjoyment using the VPModel over the two traditional camera prototype approaches. In summary, the VPModel can be used to support design strategy and to convey design concepts fully and efficiently, which indicates a potential use for the VPModel in shortening product development cycles and reducing communication costs.Keywords
Funding Information
- National Natural Science Foundation of China (91748127)
This publication has 36 references indexed in Scilit:
- Analysis of the Accuracy and Robustness of the Leap Motion ControllerSensors, 2013
- REVELACM Transactions on Graphics, 2012
- Additive Manufacturing Technologies – Rapid Prototyping to Direct Digital ManufacturingAssembly Automation, 2012
- Augmented Reality: A ReviewMedical Reference Services Quarterly, 2012
- Use of Tangible and Augmented Reality Models in Engineering Graphics CoursesJournal of Professional Issues in Engineering Education and Practice, 2011
- Virtual manipulator-based binocular stereo vision positioning system and errors modellingMachine Vision and Applications, 2010
- Augmented Reality in Architecture and Design: Potentials and Challenges for ApplicationInternational Journal of Architectural Computing, 2009
- Tangible augmented prototyping of digital handheld productsComputers in Industry, 2009
- Usability Test of Immersion for Augmented Reality Based Product Design2007
- From CAD to virtual reality: modelling approaches, data exchange and interactive 3D building design toolsAutomation in Construction, 2000