Model Touch Pointing and Detect Parkinson's Disease via a Mobile Game
Open Access
- 13 May 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (2) , 1-24
Abstract
Touch pointing is one of the primary interaction actions on mobile devices. In this research, we aim to (1) model touch pointing for people with Parkinson's Disease (PD), and (2) detect PD via touch pointing. We created a mobile game called MoleBuster in which a user performs a sequence of pointing actions. Our study with 40 participants shows that PD participants exhibited distinct pointing behavior. PD participants were much slower and had greater variances in movement time (MT), while their error rate was slightly lower than age-matched non-PD participants, indicating PD participants traded speed for accuracy. The nominal width Finger-Fitts law showed greater fitness than Fitts' law, suggesting this model should be adopted in lieu of Fitts' law to guide mobile interface design for PD users. We also proposed a CNN-Transformer-based neural network model to detect PD. Taking touch pointing data and comfort rating of finger movement as input, this model achieved an AUC of 0.97 and sensitivity of 0.95 in leave-one-user-out cross-validation. Overall, our research contributes models that reveal the temporal and spatial characteristics of touch pointing for PD users, and provide a new method (CNN-Transformer model) and a mobile game (MoleBuster) for convenient PD detection.Keywords
This publication has 59 references indexed in Scilit:
- Computer Mouse Use Captures Ataxia and Parkinsonism, Enabling Accurate Measurement and DetectionMovement Disorders, 2019
- Advanced modeling of selection and steering data: beyond Fitts' lawInternational Journal of Human-Computer Studies, 2016
- Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Process, format, and clinimetric testing planMovement Disorders, 2007
- “Beating” Fitts’ law: virtual enhancements for pointing facilitationInternational Journal of Human-Computer Studies, 2004
- Fitts’ law 50 years later: applications and contributions from human–computer interactionInternational Journal of Human-Computer Studies, 2004
- The bradykinesia akinesia incoordination test (BRAIN TEST ), an objective and user-friendly means to evaluate patients with ParkinsonismMovement Disorders, 2000
- Parkinson's DiseaseNew England Journal of Medicine, 1998
- Information capacity of discrete motor responses under different cognitive sets.Journal of Experimental Psychology, 1966
- Information capacity of discrete motor responses.Journal of Experimental Psychology, 1964
- The information capacity of the human motor system in controlling the amplitude of movement.Journal of Experimental Psychology, 1954