Using marking menus to develop command sets for computer vision based hand gesture interfaces
Authors:
Open Access
- 19 October 2002
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 239-242
Abstract
This paper presents the first stages of a project that studies the use of hand gestures for interaction, in an approach based on computer vision. A first prototype for exploring the use of marking menus for interaction has been built. The purpose is not menu-based interaction per se, but to study if marking menus, with practice, could support the development of autonomous command sets for gestural interaction. Some early observations are reported, mainly concerning problems with user fatigue and precision of gestures. Future work is discussed, such as introducing flow menus for reducing fatigue, and control menus for continuous control functions. The computer vision algorithms will also have to be developed further.Keywords
This publication has 12 references indexed in Scilit:
- A system for person-independent hand posture recognition against complex backgroundsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research DirectionsHuman–Computer Interaction, 2000
- Control menus2000
- Perceptual user interfaces (introduction)Communications of the ACM, 2000
- FlowMenu2000
- Real-time American sign language recognition using desk and wearable computer based videoIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Visual interpretation of hand gestures for human-computer interaction: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- An approach to natural gesture in virtual environmentsACM Transactions on Computer-Human Interaction, 1995
- CharadeCommunications of the ACM, 1993
- “Put-that-there”ACM SIGGRAPH Computer Graphics, 1980