Gamified Rehabilitation and Physiotherapy Using MediaPipe for Posture and Hand Gesture Recognition
Authors:
- 19 December 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 786-789
Abstract
Introduction: Rehabilitation for conditions affecting mobility, such as stroke, muscle atrophy, and others, poses significant challenges in traditional physiotherapy practices. Engaging patients in enjoyable exercises is crucial for maintaining compliance with rehabilitation protocols. In response, this paper introduces a pioneering game-based approach to rehabilitation, leveraging posture detection technology. Materials and Methods: A game-based rehabilitation system was developed utilizing deep learning techniques through the MediaPipe framework for posture and hand gesture recognition. The system analyzes user posture in real time via a webcam and translates these movements into game controls, allowing patients to interact with popular games like Subway Surfers to simulate physical activities such as running and jumping. Latency between patient movements and in-game responses was measured across three hardware configurations (8GB, 12GB, and 16GB RAM) to evaluate system performance and responsiveness. Results and Discussion: Latency decreased with higher RAM, with the lowest measured at 430 ms on a 16GB configuration. This real-time responsiveness enhances patient engagement, making the rehabilitation process more immersive and effective. By leveraging posture detection technology, this innovative system bridges the gap between the necessity of rehabilitation exercises and the appeal of gaming, offering a promising solution for improving treatment outcomes across diverse age groups and conditions.Keywords
This publication has 16 references indexed in Scilit:
- Physiotherapists' perspective of telehealth during the Covid-19 pandemicInternational Journal of Medical Informatics, 2021
- A review of computer vision-based approaches for physical rehabilitation and assessmentMultimedia Systems, 2021
- Reversible Data Hiding for Electronic Patient Information Security for Telemedicine ApplicationsArabian Journal for Science and Engineering, 2021
- Secure CT-Image Encryption for COVID-19 Infections Using HBBS-Based Multiple Key-StreamsArabian Journal for Science and Engineering, 2021
- Physioland – A serious game for physical rehabilitation of patients with neurological diseasesEntertainment Computing, 2020
- Brain MR Imaging Tumor Detection Using Monogenic Signal Analysis-Based Invariant Texture DescriptorsArabian Journal for Science and Engineering, 2019
- The use of commercial video games in rehabilitation: a systematic reviewInternational Journal of Rehabilitation Research, 2016
- Barriers to home-based exercise program adherence with chronic low back pain: Patient expectations regarding new technologiesAnnals of Physical and Rehabilitation Medicine, 2016
- Serious Games and Edutainment Applications2011
- Optimising engagement for stroke rehabilitation using serious gamesThe Visual Computer, 2009