BlinkListener
Authors:
Open Access
- 23 June 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 5 (2) , 1-27
Abstract
Eye blink detection plays a key role in many real-life applications such as Human-Computer Interaction (HCI), drowsy driving prevention and eye disease detection. Although traditional camera-based techniques are promising, multiple issues hinder their wide adoption including the privacy concern, strict lighting condition and line-of-sight (LoS) requirements. On the other hand, wireless sensing without a need for dedicated sensors gains a tremendous amount of attention in recent years. Among the wireless signals utilized for sensing, acoustic signals show a unique potential for fine-grained sensing owing to their low propagation speed in the air. Another trend favoring acoustic sensing is the wide availability of speakers and microphones in commodity devices. Promising progress has been achieved in fine-grained human motion sensing such as breathing using acoustic signals. However, it is still very challenging to employ acoustic signals for eye blink detection due to the unique characteristics of eye blink (i.e., subtle, sparse and aperiodic) and severe interference (i.e., from the human target himself and surrounding objects). We find that even the very subtle involuntary head movement induced by breathing can severely interfere with eye blink detection. In this work, for the first time, we propose a system called BlinkListener to sense the subtle eye blink motion using acoustic signals in a contact-free manner. We first quantitatively model the relationship between signal variation and the subtle movements caused by eye blink and interference. Then, we propose a novel method that exploits the "harmful" interference to maximize the subtle signal variation induced by eye blinks. We implement BlinkListener on both a research-purpose platform (Bela) and a commodity smartphone (iPhone 5c). Experiment results show that BlinkListener can achieve robust performance with a median detection accuracy of 95%. Our system can achieve high accuracies when the smartphone is held in hand, the target wears glasses/sunglasses and in the presence of strong interference with people moving around.Keywords
Funding Information
- the Fundamental Research Funds for the Central Universities (DUT20ZD210, DUT20TD107)
- National Key Research and Development Program of China (2017YFC0821003-2)
- Dalian Science and Technology Innovation Fund (2019J11CY004, 2020JJ26GX037)
- National Natural Science Foundation of China (61902052)
- Science and Technology Major Industrial Project of Liaoning Province (2020JH1/10100013)
This publication has 48 references indexed in Scilit:
- Understanding and Modeling of WiFi Signal Based Human Activity Recognition2015
- Human Sensing Using Visible Light Communication2015
- Smart Homes that Monitor Breathing and Heart Rate2015
- Effect of a light-emitting timer device on the blink rate of non-dry eye individuals and dry eye patientsBritish Journal of Ophthalmology, 2013
- Whole-home gesture recognition using wireless signals2013
- Do-It-Yourself Eye Tracker: Low-Cost Pupil-Based Eye Tracker for Computer Graphics Applications2012
- Eye-blink detection system for human–computer interactionUniversal Access in the Information Society, 2011
- Measuring and predicting eyelid spectral transmittanceJournal of Biomedical Optics, 2011
- Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?Ergonomics, 2008
- Real-time eye detection and tracking under various light conditions2002