Evaluation of activities of daily living using an electronic version of the Longshi Scale in patients with stroke: reliability, consistency, and preference
Open Access
- 15 May 2024
- journal article
- research article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 24 (1) , 1-12
Abstract
Background: The Longshi Scale is a pictorial assessment tool for evaluating activities of daily living (ADL) in patients with stroke. The paper-based version presents challenges; thus, the WeChat version was created to enhance accessibility. Herein, we aimed to validate the inter-rater and test–retest reliabilities of the WeChat version of the Longshi Scale and explore its potential clinical applications.Methods: We recruited 115 patients with stroke in the study. The ADL results of each patient were assessed using both the WeChat and paper-based version of the Longshi Scale; each evaluation was conducted by 28 health professionals and 115 caregivers separately. To explore the test–retest reliability of the WeChat version, 22 patients were randomly selected and re-evaluated by health professionals using the WeChat version. All evaluation criteria were recorded, and all evaluators were surveyed to indicate their preference between the two versions.Results: Consistency between WeChat and the paper-based Longshi Scale was high for ADL scores by health professionals (ICC2,1 = 0.803–0.988) and caregivers (ICC2,1 = 0.845–0.983), as well as for degrees of disability (κw = 0.870 by professionals; κw = 0.800 by caregivers). Bland–Altman analysis showed no significant discrepancies. The WeChat version exhibited good test–retest reliability (κw = 0.880). The WeChat version showed similar inter-rater reliability in terms of the ADL score evaluated using the paper-based version (ICC2,1 = 0.781–0.941). The time to complete assessments did not differ significantly, although the WeChat version had a shorter information entry time (P < 0.001, 95% confidence interval: –43.463 to –15.488). Health professionals favored the WeChat version (53.6%), whereas caregivers had no significant preference.Conclusions: The WeChat version of the Longshi Scale is reliable and serves as a suitable alternative for health professionals and caregivers to assess ADL levels in patients with stroke. The WeChat version of the Longshi Scale is considered user-friendly by health professionals, although it is not preferred by caregivers.Trial registration: This study was approved by the Ethics Committee of the Second People’s Hospital of Shenzhen (approval number: 20210812003-FS01) and registered on the Clinical Trial Register Center website: clinicaltrials.gov on January 31, 2022 (registration no.: NCT05214638).Keywords
Funding Information
- Sanming Project of Medicine in Shenzen Municipality (SZSM202111010)
- National Key Research and Development Program of China (2020YFC2008700)
This publication has 34 references indexed in Scilit:
- Using Digital Health Technology to Better Generate Evidence and Deliver Evidence-Based CareJACC, 2018
- Digital health in the Americas: advances and challenges in connected healthBMJ Innovations, 2018
- The usability of a WeChat-based electronic questionnaire for collecting participant-reported data in female pelvic floor disorders: a comparison with the traditional paper-administered formatMenopause, 2016
- Equivalence of electronic and paper administration of patient-reported outcome measures: a systematic review and meta-analysis of studies conducted between 2007 and 2013Health and Quality of Life Outcomes, 2015
- Trainee Occupational Therapists Scoring the Barthel ADLJournal of Medical Systems, 2015
- Equivalence of electronic and paper-based patient-reported outcome measuresQuality of Life Research, 2015
- Evaluating Tablet Computers as a Survey Tool in Rural CommunitiesThe Journal of Rural Health, 2014
- Recommendations on Evidence Needed to Support Measurement Equivalence between Electronic and Paper-Based Patient-Reported Outcome (PRO) Measures: ISPOR ePRO Good Research Practices Task Force ReportValue in Health, 2009
- A comparison of an electronic version of the SF-36 General Health Questionnaire to the standard paper versionQuality of Life Research, 2002
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977