Remote Self-Administration of Cognitive Screeners for Older Adults Prior to a Primary Care Visit: Pilot Cross-Sectional Study of the Reliability and Usability of the MyCog Mobile Screening App (Preprint)
Authors:
- Stephanie Ruth YoungSYStephanie Ruth Young
- Elizabeth McManus DworakEDElizabeth McManus Dworak
- Greg Joseph ByrneGBGreg Joseph Byrne
- Callie Madison JonesCJCallie Madison Jones
- Lihua YaoLYLihua Yao
- Julia Noelani Yoshino BenaventeJBJulia Noelani Yoshino Benavente
- Maria Varela DiazMDMaria Varela Diaz
- Laura CurtisLCLaura Curtis
- Richard GershonRGRichard Gershon
- Michael WolfMWMichael Wolf
- Cindy J NowinskiCNCindy J Nowinski
Preprint
- 15 November 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Routine cognitive screening is essential in the early detection of dementia, but time constraints in primary care settings often limit clinicians’ ability to conduct screenings. MyCog Mobile is a newly developed cognitive screening system that patients can self-administer on their smartphones before a primary care visit, which can help save clinics’ time, encourage broader screening practices, and increase early detection of cognitive decline. OBJECTIVE The goal of this pilot study was to examine the feasibility, acceptability, and initial psychometric properties of MyCog Mobile. Research questions included (1) Can older adults complete MyCog Mobile remotely without staff support? (2) Are the internal consistency and test-retest reliability of the measures acceptable? and (3) How do participants rate the user experience of MyCog Mobile? METHODS A sample of adults aged 65 years and older (N=51) self-administered the MyCog Mobile measures remotely on their smartphones twice within a 2- to 3-week interval. The pilot version of MyCog Mobile includes 4 activities: MyFaces measures facial memory, MySorting measures executive functioning, MySequences measures working memory, and MyPictures measures episodic memory. After their first administration, participants also completed a modified version of the Simplified System Usability Scale (S-SUS) and 2 custom survey items. RESULTS All participants in the sample passed the practice items and completed each measure. Findings indicate that the Mobile Toolbox assessments measure the constructs well (internal consistency 0.73 to 0.91) and are stable over an approximately 2-week delay (test-retest reliability 0.61 to 0.71). Participants’ rating of the user experience (mean S-SUS score 73.17, SD 19.27) indicated that older adults found the usability of MyCog Mobile to be above average. On free-response feedback items, most participants provided positive feedback or no feedback at all, but some indicated a need for clarity in certain task instructions, concerns about participants’ abilities, desire to be able to contact a support person or use in-app technical support, and desire for additional practice items. CONCLUSIONS Pilot evidence suggests that the MyCog Mobile cognitive screener can be reliably self-administered by older adults on their smartphones. Participants in our study generally provided positive feedback about the MyCog Mobile experience and rated the usability of the app highly. Based on participant feedback, we will conduct further usability research to improve support functionality, optimize task instructions and practice opportunities, and ensure that patients feel comfortable using MyCog Mobile. The next steps include a clinical validation study that compares MyCog Mobile to gold-standard assessments and tests the sensitivity and specificity of the measures for identifying dementia.Keywords
All Related Versions
- Published version: JMIR Formative Research, 8 (1), e54299.
This publication has 23 references indexed in Scilit:
- Prevalence and determinants of undetected dementia in the community: a systematic literature review and a meta-analysisBMJ Open, 2017
- Feasibility and validity of mobile cognitive testing in the investigation of age‐related cognitive declineInternational Journal of Methods in Psychiatric Research, 2016
- A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability ResearchJournal of Chiropractic Medicine, 2016
- Attitudes and preferences towards screening for dementia: a systematic review of the literatureBMC Geriatrics, 2015
- Older Primary Care Patients’ Attitudes and Willingness to Screen for DementiaJournal of Aging Research, 2015
- Lord–Wingersky Algorithm Version 2.0 for Hierarchical Item Factor Models with Applications in Test Scoring, Scale Alignment, and Model Fit TestingPsychometrika, 2014
- Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the ElderlyPLOS ONE, 2013
- Face-name associative memory performance is related to amyloid burden in normal elderlyNeuropsychologia, 2011
- Missed and Delayed Diagnosis of Dementia in Primary CareAlzheimer Disease & Associated Disorders, 2009
- Status of computerized cognitive testing in aging: A systematic reviewAlzheimer's & Dementia, 2008