Toward More Comprehensive Evaluations of 3D Immersive Sketching, Drawing, and Painting
- 15 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (8) , 4648-4664
Abstract
To understand current practice and explore the potential for more comprehensive evaluations of 3D immersive sketching, drawing, and painting, we present a survey of evaluation methodologies used in existing 3D sketching research, a breakdown and discussion of important phases (sub-tasks) in the 3D sketching process, and a framework that suggests how these factors can inform evaluation strategies in future 3D sketching research. Existing evaluations identified in the survey are organized and discussed within three high-level categories: 1) evaluating the 3D sketching activity, 2) evaluating 3D sketching tools, and 3) evaluating 3D sketching artifacts. The new framework suggests targeting evaluations to one or more of these categories and identifying relevant user populations. In addition, building upon the discussion of the different phases of the 3D sketching process, the framework suggests to evaluate relevant sketching tasks, which may range from low-level perception and hand movements to high-level conceptual design. Finally, we discuss limitations and challenges that arise when evaluating 3D sketching, including a lack of standardization of evaluation methods and multiple, potentially conflicting, ways to evaluate the same task and user interface usability; we also identify opportunities for more holistic evaluations. We hope the results can contribute to accelerating research in this domain and, ultimately, broad adoption of immersive sketching systems.Keywords
This publication has 128 references indexed in Scilit:
- User attention and behaviour in virtual reality art encounterMultimedia Tools and Applications, 2022
- VRSketch: Investigating 2D Sketching in Virtual Reality with Different Levels of Hand and Pen Transparency2021
- Evaluating Consumer Interaction Interfaces for 3D Sketching in Virtual Reality2021
- 3D Sketching in VR Changing PDM Processes2020
- The Use of Immersive Technologies for Concept Design2020
- Examining creativity through a virtual reality support systemEducational Technology Research and Development, 2018
- Behavior Mapping of Sketching in VR Space with Physical Tablet Interface2018
- Brush2Model: Convolution surface‐based brushes for 3D modelling in head‐mounted display‐based virtual environmentsComputer Animation and Virtual Worlds, 2017
- AiRSculpt: A Wearable Augmented Reality 3D Sculpting System2014
- AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität2003