Demonstration of CameraMouseAI: A Head-Based Mouse-Control System for People with Severe Motor Disabilities
Open Access
- 27 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Abstract
We propose the mouse control system CameraMouseAI that includes real-time facial feature detection and new ways to map facial feature movements to mouse clicks. In addition to selecting items on the screen with the traditional dwell-time mechanism, users can perform mouse commands on the screen by opening their mouth or raising their eyebrows. The modular and open source design of CameraMouseAI enables developers to update the platform with new computer vision and machine learning models and extend its functionality. User experiments with the CameraMouseAI involved target selection, web browsing, and typing. A group of 12 adults without motor impairments and four adults with severe motor impairments were able to use the application to complete both target selection and web browsing tasks.Keywords
This publication has 24 references indexed in Scilit:
- Exploration of Assistive Technologies Used by People with Quadriplegia Caused by Degenerative Neurological DiseasesInternational Journal of Human–Computer Interaction, 2017
- Current state of digital signal processing in myoelectric interfaces and related applicationsBiomedical Signal Processing and Control, 2015
- Using kernels for a video-based mouse-replacement interfacePersonal and Ubiquitous Computing, 2012
- Adaptive Mouse-Replacement Interface Control Functions for Users with Disabilities2011
- Handbook of Ambient Intelligence and Smart Environments2010
- Hands-free vision-based interface for computer accessibilityJournal of Network and Computer Applications, 2008
- Application of facial electromyography in computer mouse access for people with disabilitiesDisability and Rehabilitation, 2006
- Face as Mouse Through Visual Face Tracking2005
- Nouse ‘use your nose as a mouse’ perceptual vision technology for hands-free games and interfacesImage and Vision Computing, 2004
- Communication via eye blinks and eyebrow raises: video-based human-computer interfacesUniversal Access in the Information Society, 2003