Eye-Hand Movement of Objects in Near Space
Open Access
- 27 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 18-21
Abstract
Hand-tracking in Extended Reality (XR) enables moving objects in near space with direct hand gestures, to pick, drag and drop objects in 3D. We explore the use of eye-tracking to reduce the effort involved in this interaction. As the eyes naturally look ahead to the target for a drag operation, the principal idea is to map the translation of the object in the image plane to gaze, such that the hand only needs to control the depth component of the operation. We demo several applications we build for 3D manipulations, including area selection, 3D path specification, and a "Bejeweled" inspired game, showing potential for effortless drag-and-drop actions in 3D space. This demonstration includes the study apparatus and the applications from a paper that will be presented at UIST’24 with the same title [11].Keywords
Funding Information
- European Research Council (ERC) under the European Union?s Horizon 2020 research and innovation programme (grants no. 101021229 GEMINI, and no. 740548 CIO)
This publication has 14 references indexed in Scilit:
- Exploring Gaze-assisted and Hand-based Region Selection in Augmented RealityProceedings of the ACM on Human-Computer Interaction, 2023
- Conductor: Intersection-Based Bimanual Pointing in Augmented and Virtual RealityProceedings of the ACM on Human-Computer Interaction, 2022
- In-Depth Mouse: Integrating Desktop Mouse into Virtual Reality2022
- Gaze-Supported 3D Object Manipulation in Virtual Reality2021
- Gaze + pinch interaction in virtual reality2017
- Gaze and Touch Interaction on Tablets2016
- Advantages of velocity-based scaling for distant 3D manipulation2008
- Testbed evaluation of virtual environment interaction techniques1999
- Manual and gaze input cascaded (MAGIC) pointing1999
- The go-go interaction technique1996