Eye-gesture control of computer systems via artificial intelligence
Open Access
- 25 February 2025
- journal article
- Published by F1000 Research Ltd in F1000Research
- Vol. 13, 109
Abstract
Background Artificial Intelligence (AI) offers transformative potential for human-computer interaction, particularly through eye-gesture recognition, enabling intuitive control for users and accessibility for individuals with physical impairments. Methods We developed an AI-driven eye-gesture recognition system using tools like OpenCV, MediaPipe, and PyAutoGUI to translate eye movements into commands. The system was trained on a dataset of 20,000 gestures from 100 diverse volunteers, representing various demographics, and tested under different conditions, including varying lighting and eyewear. Results The system achieved 99.63% accuracy in recognizing gestures, with slight reductions to 98.9% under reflective glasses. These results demonstrate its robustness and adaptability across scenarios, confirming its generalizability. Conclusions This system advances AI-driven interaction by enhancing accessibility and unlocking applications in critical fields like military and rescue operations. Future work will validate the system using publicly available datasets to further strengthen its impact and usability.Keywords
Funding Information
- Rabdan Academy
This publication has 57 references indexed in Scilit:
- FSTL-SA: few-shot transfer learning for sentiment analysis from facial expressionsMultimedia Tools and Applications, 2024
- Monkeypox recognition and prediction from visuals using deep transfer learning-based neural networksMultimedia Tools and Applications, 2024
- Real-time human-computer interaction using eye gazesManufacturing Letters, 2023
- Fine-grained activity classification in assembly based on multi-visual modalitiesJournal of Intelligent Manufacturing, 2023
- Improvement of power quality parameters using modulated-unified power quality conditioner and switched-inductor boost converter by the optimization techniques for a hybrid AC/DC microgridScientific Reports, 2022
- The Power of Voice to Convey Emotion in Multimedia Instructional MessagesInternational Journal of Artificial Intelligence in Education, 2022
- The emergence of “truth machines”?: Artificial intelligence approaches to lie detectionEthics and Information Technology, 2022
- A power management control and optimization of a wind turbine with battery storage systemJournal of Energy Storage, 2022
- Artificial Intelligence Based Techniques for the Detection of Socio-Behavioral Disorders: A Systematic ReviewArchives of Computational Methods in Engineering, 2021
- State-of-the-art in artificial neural network applications: A surveyHeliyon, 2018