It's all about you: Personalized in-Vehicle Gesture Recognition with a Time-of-Flight Camera
Preprint
Abstract
Despite significant advances in gesture recognition technology, recognizing gestures in a driving environment remains challenging due to limited and costly data and its dynamic, ever-changing nature. In this work, we propose a model-adaptation approach to personalize the training of a CNNLSTM model and improve recognition accuracy while reducing data requirements. Our approach contributes to the field of dynamic hand gesture recognition while driving by providing a more efficient and accurate method that can be customized for individual users, ultimately enhancing the safety and convenience of in-vehicle interactions, as well as driver's experience and system trust. We incorporate hardware enhancement using a time-of-flight camera and algorithmic enhancement through data augmentation, personalized adaptation, and incremental learning techniques. We evaluate the performance of our approach in terms of recognition accuracy, achieving up to 90\%, and show the effectiveness of personalized adaptation and incremental learning for a user-centered design.Keywords
All Related Versions
- Version 1, 2023-10-02, ArXiv
- Published version: , 234.
This publication has 19 references indexed in Scilit:
- An improved hand gesture recognition system using keypoints and hand bounding boxesArray, 2022
- Human-Centered Artificial Intelligence: Reliable, Safe & TrustworthyInternational Journal of Human–Computer Interaction, 2020
- Implementation and Evaluation of Touch and Gesture Interaction Modalities for In-vehicle Infotainment Systems2019
- How Society Can Maintain Human-Centric Artificial Intelligence2019
- Assessing Artificial Intelligence for Humanity: Will AI be the Our Biggest Ever Advance ? or the Biggest Threat [Opinion]IEEE Technology and Society Magazine, 2018
- Hand gesture recognition based on convolution neural networkCluster Computing, 2017
- Hand Gesture Recognition for Human Computer InteractionProcedia Computer Science, 2017
- The design of hand gestures for human–computer interaction: Lessons from sign language interpretersInternational Journal of Human-Computer Studies, 2014
- Hand gesture recognition using a neural network shape fitting techniqueEngineering Applications of Artificial Intelligence, 2009
- Hand gesture recognition using a real-time tracking method and hidden Markov modelsImage and Vision Computing, 2003