Autoencoder as a New Method for Maintaining Data Privacy While Analyzing Videos of Patients With Motor Dysfunction: Proof-of-Concept Study
Authors:
- Marcus D'SouzaMDMarcus D'Souza
- Caspar E P Van MunsterCMCaspar E P Van Munster
- Jonas F DornJDJonas F Dorn
- Alexis DorierADAlexis Dorier
- Christian P KammCKChristian P Kamm
- Saskia SteinheimerSSSaskia Steinheimer
- Frank DahlkeFDFrank Dahlke
- Bernard M J UitdehaagBUBernard M J Uitdehaag
- Ludwig KapposLKLudwig Kappos
- Matthew JohnsonMJMatthew Johnson
Open Access
- 8 May 2020
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (5) , e16669
Abstract
Background: In chronic neurological diseases, especially in multiple sclerosis (MS), clinical assessment of motor dysfunction is crucial to monitor the disease in patients. Traditional scales are not sensitive enough to detect slight changes. Video recordings of patient performance are more accurate and increase the reliability of severity ratings. When these recordings are automated, quantitative disability assessments by machine learning algorithms can be created. Creation of these algorithms involves non–health care professionals, which is a challenge for maintaining data privacy. However, autoencoders can address this issue. Objective: The aim of this proof-of-concept study was to test whether coded frame vectors of autoencoders contain relevant information for analyzing videos of the motor performance of patients with MS. Methods: In this study, 20 pre-rated videos of patients performing the finger-to-nose test were recorded. An autoencoder created encoded frame vectors from the original videos and decoded the videos again. The original and decoded videos were shown to 10 neurologists at an academic MS center in Basel, Switzerland. The neurologists tested whether the 200 videos were human-readable after decoding and rated the severity grade of each original and decoded video according to the Neurostatus-Expanded Disability Status Scale definitions of limb ataxia. Furthermore, the neurologists tested whether ratings were equivalent between the original and decoded videos. Results: In total, 172 of 200 (86.0%) videos were of sufficient quality to be ratable. The intrarater agreement between the original and decoded videos was 0.317 (Cohen weighted kappa). The average difference in the ratings between the original and decoded videos was 0.26, in which the original videos were rated as more severe. The interrater agreement between the original videos was 0.459 and that between the decoded videos was 0.302. The agreement was higher when no deficits or very severe deficits were present. Conclusions: The vast majority of videos (172/200, 86.0%) decoded by the autoencoder contained clinically relevant information and had fair intrarater agreement with the original videos. Autoencoders are a potential method for enabling the use of patient videos while preserving data privacy, especially when non–health-care professionals are involved.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Reference videos reduce variability of motor dysfunction assessments in multiple sclerosisMultiple Sclerosis Journal – Experimental, Translational and Clinical, 2018
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017
- Using deep learning to investigate the neuroimaging correlates of psychiatric and neurological disorders: Methods and applicationsNeuroscience & Biobehavioral Reviews, 2017
- Outcome Measures in Clinical Trials for Multiple SclerosisCNS Drugs, 2017
- Deep Residual Learning for Image Recognition2016
- Usability and Acceptability of ASSESS MS: Assessment of Motor Dysfunction in Multiple Sclerosis Using Depth-Sensing Computer VisionJMIR Human Factors, 2015
- Disability outcome measures in multiple sclerosis clinical trials: current status and future prospectsThe Lancet Neurology, 2012
- Modeling word perception using the Elman networkNeurocomputing, 2008
- Multiscale structural similarity for image quality assessment2004
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977