Intent Inference for Hand Pointing Gesture-Based Interactions in Vehicles
Authors:
- 28 April 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 46 (4) , 878-889
Abstract
Using interactive displays, such as a touchscreen, in vehicles typically requires dedicating a considerable amount of visual as well as cognitive capacity and undertaking a hand pointing gesture to select the intended item on the interface. This can act as a distractor from the primary task of driving and consequently can have serious safety implications. Due to road and driving conditions, the user input can also be highly perturbed resulting in erroneous selections compromising the system usability. In this paper, we propose intent-aware displays that utilize a pointing gesture tracker in conjunction with suitable Bayesian destination inference algorithms to determine the item the user intends to select, which can be achieved with high confidence remarkably early in the pointing gesture. This can drastically reduce the time and effort required to successfully complete an in-vehicle selection task. In the proposed probabilistic inference framework, the likelihood of all the nominal destinations is sequentially calculated by modeling the hand pointing gesture movements as a destination-reverting process. This leads to a Kalman filter-type implementation of the prediction routine that requires minimal parameter training and has low computational burden; it is also amenable to parallelization. The substantial gains obtained using an intent-aware display are demonstrated using data collected in an instrumented vehicle driven under various road conditions.Keywords
Funding Information
- Jaguar Land Rover under the Centre for Advanced Photonics and Electronics agreement
This publication has 40 references indexed in Scilit:
- Direct-touch vs. mouse input for navigation modes of the web mapDisplays, 2011
- The effects of motion on in-vehicle touch screen system operation: A battle management system case studyTransportation Research Part F: Traffic Psychology and Behaviour, 2011
- Review of Statistical Arbitrage, Cointegration, and Multivariate Ornstein-UhlenbeckSSRN Electronic Journal, 2009
- Fitts' law and expanding targetsACM Transactions on Computer-Human Interaction, 2005
- Ubiquitous computing within cars: designing controls for non-visual useInternational Journal of Human-Computer Studies, 2001
- Divided attention during encoding and retrieval: Differential control effects?Journal of Experimental Psychology: Learning, Memory, and Cognition, 2000
- Improvement of Pointing Time by Predicting Targets in Pointing With a PC MouseInternational Journal of Human–Computer Interaction, 1998
- Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasksElectroencephalography and Clinical Neurophysiology, 1991
- The Movement Speed-Accuracy Relationship in Space-Time1985
- Information capacity of discrete motor responses.Journal of Experimental Psychology, 1964