Combining Speech, Gaze, and Micro-gestures for the Multimodal Control of In-Car Functions
Authors:
- 27 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 190-193
Abstract
Modern cars are already incredibly smart environments today due to the sheer number of sensors and processors packed into a small space. Likewise, new technologies in human-computer interaction increasingly find their way inside, e.g. eye tracking, speech interaction and gesture recognition. The support of new modalities is promising a reduction of driver distraction and a better handling of an increasing number of functions offered by in-vehicle systems. With multiple modalities to choose from, which can be combined arbitrarily via multimodal fusion, drivers can make a free choice depending on the demands of the situation and their preferences. Our paper presents a prototype in-car system that allows car features (like turning lights and windows) to be controlled by combinations of speech, gaze, and micro-gestures. We propose an interaction concept, sketch our architecture based on a domain-independent multimodal dialogue platform, and draw some first conclusions on the outcome.Keywords
This publication has 10 references indexed in Scilit:
- EyeVIUS2014
- Using Eye-Gaze and Visualization to Augment Memory2014
- Multimodal interaction in the car2012
- Personalized In-Vehicle Information Systems: Building an Application Infrastructure for Smart Cars in Smart Spaces2012
- Gestural Interaction in Vehicular ApplicationsComputer, 2012
- Multimodal Input in the Car, Today and TomorrowIEEE MultiMedia, 2011
- Language pattern analysis for automotive natural language speech applications2010
- 2nd multimodal interfaces for automotive applications (MIAA 2010)2010
- Driver Inattention Detection based on Eye Gaze—Road Event CorrelationThe International Journal of Robotics Research, 2009
- When do we interact multimodally?2004