Augmenting Ear Accessories for Facial Gesture Input Using Infrared Distance Sensor Array
Open Access
- 5 May 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (9) , 1480
Abstract
Simple hands-free input methods using ear accessories have been proposed to broaden the range of scenarios in which information devices can be operated without hands. Although many previous studies use canal-type earphones, few studies focused on the following two points: (1) A method applicable to ear accessories other than canal-type earphones. (2) A method enabling various ear accessories with different styles to have the same hands-free input function. To realize these two points, this study proposes a method to recognize the user’s facial gesture using an infrared distance sensor attached to the ear accessory. The proposed method detects skin movement around the ear and face, which differs for each facial expression gesture. We created a prototype system for three ear accessories for the root of the ear, earlobe, and tragus. The evaluation results for nine gestures and 10 subjects showed that the F-value of each device was 0.95 or more, and the F-value of the pattern combining multiple devices was 0.99 or more, which showed the feasibility of the proposed method. Although many ear accessories could not interact with information devices, our findings enable various ear accessories with different styles to have eye-free and hands-free input ability based on facial gestures.Keywords
Funding Information
- Japan Society for the Promotion of Science (JP19K20330)
This publication has 38 references indexed in Scilit:
- EarTouch2017
- HeadPager: Page Turning with Computer Vision Based Head Interaction2017
- Evaluation of HeadTurn2016
- What you look at is what you getInteractions, 2016
- Conductive rubber electrodes for earphone-based eye gesture input interfacePersonal and Ubiquitous Computing, 2014
- Head and Eye Movement as Pointing Modalities for Eyewear Computers2014
- Hands-free interaction with a computer and other technologiesUniversal Access in the Information Society, 2009
- Hands-free vision-based interface for computer accessibilityJournal of Network and Computer Applications, 2008
- Using confidence scores to improve hands-free speech based navigation in continuous dictation systemsACM Transactions on Computer-Human Interaction, 2004
- Nouse ‘use your nose as a mouse’ perceptual vision technology for hands-free games and interfacesImage and Vision Computing, 2004