DESIGNING HAND GESTURE VOCABULARIES FOR NATURAL INTERACTION BY COMBINING PSYCHO-PHYSIOLOGICAL AND RECOGNITION FACTORS
Authors:
- 1 March 2008
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Semantic Computing
- Vol. 02 (01) , 137-160
Abstract
A need exists for intuitive hand gesture machine interaction in which the machine not only recognizes gestures, but also the human feels comfortable and natural in their execution. The gesture vocabulary design problem is rigorously formulated as a multi-objective optimization problem. Psycho-physiological measures (intuitiveness, comfort) and gesture recognition accuracy are taken as the multi-objective factors. The hand gestures are static and recognized by a vision based fuzzy c-means classifier. A meta-heuristic approach decomposes the problem into two sub-problems: finding the subsets of gestures that meet a minimal accuracy requirement, and matching gestures to commands to maximize the human factors objective. The result is a set of Pareto optimal solutions in which no objective may be increased without a concomitant decrease in another. Several solutions from the Pareto set are selected by the user using prioritized objectives. Software programs are developed to automate the collection of intuitive and stress indices. The method is tested for a simulated car — maze navigation task. Validation tests were conducted to substantiate the claim that solutions that maximize intuitiveness, comfort, and recognition accuracy performance measures can be used as proxies for the minimization task time objective. Learning and memorability were also tested.Keywords
This publication has 9 references indexed in Scilit:
- A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI2004
- Visual interpretation of hand gestures for human-computer interaction: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Human-robot interface by pointing with uncalibrated stereo visionImage and Vision Computing, 1996
- CharadeCommunications of the ACM, 1993
- An improved annealing scheme for the QAPEuropean Journal of Operational Research, 1990
- Normative model of human hand for biomechanical analysisJournal of Biomechanics, 1979
- Perceived exertion as an indicator of somatic stressJournal of Rehabilitation Medicine, 1970
- Assignment Problems and the Location of Economic ActivitiesEconometrica, 1957
- Factors Affecting the Cost of AirplanesJournal of the Aeronautical Sciences, 1936