User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large Display
Open Access
- 23 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 78657-78679
Abstract
The process of visual analytics is composed of the visual data exploration tasks supporting analytical reasoning. When performing analytical tasks with the interactive visual interfaces displayed by the large screen, physical discomforts such as gorilla-arm effect can be easily caused. To enrich the input space for analysts, there has been some researches concerning the cross-device analysis combining mobile devices with the large display. Although the effectiveness of expert-level designs has been demonstrated, little is known of the ordinary users’ preferences for using a mobile device to issue commands, especially the small one like smartwatch. We implement a three-stage study to investigate and validate these preferences. A total of 181 distinctive gestural inputs and 52 interface designs for 21 tasks were collected from analysts. Expert designers selected the best practices from these user-defined interactions. A performance test was subsequently developed to assess the selected interactions in terms of quantitative statistics and subjective ratings. Our work provides empirical support and proposes a set of design guidelines for optimizing watch-based interactions aimed at remote control of visual data on the large display. Through this research, we hope to advance the development of smartwatches as visual analytics tools and provide visual analysts with a better usage experience.Keywords
This publication has 63 references indexed in Scilit:
- Exploring user-defined gestures for lingual and palatal interactionJournal on Multimodal User Interfaces, 2023
- User-Defined Gestures for Dual-Screen Mobile InteractionInternational Journal of Human–Computer Interaction, 2019
- The Gesture Disagreement Problem in Free-hand Gesture InteractionInternational Journal of Human–Computer Interaction, 2018
- UX Design of a Big Data Visualization Application Supporting Gesture-Based Interaction with a Large Display2017
- Dispelling the Gorilla Arm Syndrome: The Viability of Prolonged Gesture Interactions2017
- Cross-device media: a review of second screening and multi-device televisionPersonal and Ubiquitous Computing, 2017
- Exploring the Use of Virtual Environments in an Industrial Site Design Process2015
- Using Affinity Diagrams to Evaluate Interactive Prototypes2015
- On free-hand TV control: experimental results on user-elicited gestures with Leap MotionPersonal and Ubiquitous Computing, 2015
- What is Intuitive Interaction? Balancing Users' Performance and Satisfaction with Natural User InterfacesInteracting with Computers, 2015