A Robust Noninvasive Eye Control Approach For Disabled People Based on Kinect 2.0 Sensor
Authors:
- 30 June 2017
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 1 (4) , 1-4
Abstract
A noninvasive eye control approach based on Kinect 2.0 was proposed to improve life quality for people with upper limb disabilities. First, Kinect 2.0 was used to track the critical points of the canthus and eyelid. Second, the greyscale differential algorithm was used to position the iris. Finally, a novel eye control model based on the canthus coordinates, central coordinates of pupils, and eyelid distance was established for cursor control. To reduce the calibration difficulty and the interference from eye jitter on the control, incremental indirect control was performed to ensure smooth and gradual cursor motion to the fixation point. To solve the Midas touch problem, an eye switch was proposed to reduce excessive unconscious cursor movement. Benefitting from the Kinect 2.0 advantages of high resolution, high efficiency, and good stability, the control speed reached 19.9fps in MATLAB, which meets the requirement for real-time control. The method also offers good adaptability to various noise sources, such as rotation, occlusion, and scaling. The experimental results suggest the availability and robustness of the new approach.Keywords
Funding Information
- Wenzhou Municipal Science and Technology Bureau (G20110004, C20150007)
- Natural Science Foundation of Zhejiang Province (LY15B070011, LQ15A010009, LY13H180012)
- National Natural Science Foundation of China (61673322, 21207103)
This publication has 15 references indexed in Scilit:
- Kin2. A Kinect 2 toolbox for MATLABScience of Computer Programming, 2016
- Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth SensorSensors, 2016
- Efficient quantitative assessment of facial paralysis using iris segmentation and active contour-based key points detection with hybrid classifierBMC Medical Imaging, 2016
- GANT: Gaze analysis technique for human identificationPattern Recognition, 2015
- Real-time 3D face tracking based on active appearance model constrained by depth dataImage and Vision Computing, 2014
- KinectFaceDB: A Kinect Database for Face RecognitionIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2014
- An Eye-Tracking Assistive Device Improves the Quality of Life for ALS Patients and Reduces the Caregivers’ BurdenJournal of Motor Behavior, 2014
- Online modeling for realtime facial animationACM Transactions on Graphics, 2013
- Eye tracking communication devices in amyotrophic lateral sclerosis: Impact on disability and quality of lifeAmyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 2013
- Active Appearance Models RevisitedInternational Journal of Computer Vision, 2004