Sophia Holmqvist
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Sophia Holmqvist has a total of 48 co-authors. Here are the top co-authors by number of shared publications:
- Tania Giovannetti
Department of Psychology and Neuroscience, Temple University
9 shared publications - Marina Kaplan
Department of Psychology and Neuroscience, Temple University
8 shared publications - Riya Chaturvedi
Department of Psychology and Neuroscience, Temple University, Weiss Hall1701 N 13th St, Philadelphia, US
7 shared publications - Haochang Shou
Artificial Intelligence in Biomedical Imaging Laboratory (AIBIL), Center for AI and Data Science for Integrated Diagnostics (AI2D), Perelman School of Medicine, University of Pennsylvania, Philadelphia, USA
4 shared publications - Katherine Hackett
Department of Psychology and Neuroscience, Temple University, Weiss Hall1701 N 13th St, Philadelphia, US
4 shared publications - Kimberly Halberstadter
Department of Psychology and Neuroscience, Temple University
4 shared publications
Latest Publications
- Open Access
- 30 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Associations of Wearable-Derived Physical Activity, Heart Rate Variability, and Sleep with Cognitive Performance in Older Adults (Preprint)
BACKGROUND Early detection of Alzheimer’s disease and related dementias is critical for effective intervention, yet conventional neuropsychological assessments are time-intensive and lack ecological validity, while neuroimaging and blood biomarkers are not always linked to real-world functioning. Digital phenotyping using consumer wearables offers a scalable approach to monitoring physiological and behavioral indicators of cognitive health. OBJECTIVE To examine the construct validity of smartwatch-derived heart rate variability (HRV), step count, and sleep metrics as indicators of cognitive abilities in older adults with healthy cognition or mild cognitive impairment (MCI). We hypothesized that lower HRV and step count, as well as greater sleep duration variability, would be associated with worse cognition. METHODS Participants aged ≥55 years (N=52, Mage=68.6; 42.5% male; 18.5% MCI; 29.6% Black/African American) were recruited from the Philadelphia region. Participants completed baseline neuropsychological testing and provided demographic and clinical information. Participants wore a Garmin Vivosmart 4 smartwatch for 23 hours/day over four weeks, passively recording HRV (SDNN [standard deviation of normal to normal intervals] and RMMSD [root mean square of successive differences]) during sleep and sedentary periods, daily step count, and sleep duration. Step count was derived from accelerometer data. Sleep variability was quantified using the coefficient of variation (CoV) across days. Generalized linear mixed models examined associations between wearable metrics and cognition; linear regression examined sleep duration variability. Models adjusted for relevant demographic, clinical, and device-use covariates, RESULTS Higher daily step count was positively associated with global cognition (b=1708.35, p=.021). HRV metrics were not associated with global cognition. In sensitivity analyses excluding participants with atrial fibrillation or taking medications affecting heart rate, sedentary RMSSD was positively associated with executive function (b=3.42, p=.039). Sleep duration variability was not associated with global cognition (b=-0.79, p=.721). CONCLUSIONS Findings provide partial support for the construct validity of passively collected digital measures as markers of cognition in older adulthood. Step count emerged as a robust indicator of global cognitive performance, suggesting that simple mobility-based metrics may capture meaningful variation in real-world cognitive functioning. In contrast, HRV showed limited and context-dependent associations, emerging only for executive function in participants off medications affecting heart rate when measured during sedentary periods. Sleep duration variability was not associated with cognition, suggesting that coarse wearable-derived variability metrics may not adequately capture sleep features relevant to cognitive aging. Overall, results support the promise of select passive mobility metrics for cognitive screening while underscoring the need for more refined, context-sensitive digital phenotyping approaches.
- 30 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessAssociations of Wearable-Derived Physical Activity, Heart Rate Variability, and Sleep with Cognitive Performance in Older Adults (Preprint)
BACKGROUND Early detection of Alzheimer’s disease and related dementias is critical for effective intervention, yet conventional neuropsychological assessments are time-intensive and lack ecological validity, while neuroimaging and blood biomarkers are not always linked to real-world functioning. Digital phenotyping using consumer wearables offers a scalable approach to monitoring physiological and behavioral indicators of cognitive health. OBJECTIVE To examine the construct validity of smartwatch-derived heart rate variability (HRV), step count, and sleep metrics as indicators of cognitive abilities in older adults with healthy cognition or mild cognitive impairment (MCI). We hypothesized that lower HRV and step count, as well as greater sleep duration variability, would be associated with worse cognition. METHODS Participants aged ≥55 years (N=52, Mage=68.6; 42.5% male; 18.5% MCI; 29.6% Black/African American) were recruited from the Philadelphia region. Participants completed baseline neuropsychological testing and provided demographic and clinical information. Participants wore a Garmin Vivosmart 4 smartwatch for 23 hours/day over four weeks, passively recording HRV (SDNN [standard deviation of normal to normal intervals] and RMMSD [root mean square of successive differences]) during sleep and sedentary periods, daily step count, and sleep duration. Step count was derived from accelerometer data. Sleep variability was quantified using the coefficient of variation (CoV) across days. Generalized linear mixed models examined associations between wearable metrics and cognition; linear regression examined sleep duration variability. Models adjusted for relevant demographic, clinical, and device-use covariates, RESULTS Higher daily step count was positively associated with global cognition (b=1708.35, p=.021). HRV metrics were not associated with global cognition. In sensitivity analyses excluding participants with atrial fibrillation or taking medications affecting heart rate, sedentary RMSSD was positively associated with executive function (b=3.42, p=.039). Sleep duration variability was not associated with global cognition (b=-0.79, p=.721). CONCLUSIONS Findings provide partial support for the construct validity of passively collected digital measures as markers of cognition in older adulthood. Step count emerged as a robust indicator of global cognitive performance, suggesting that simple mobility-based metrics may capture meaningful variation in real-world cognitive functioning. In contrast, HRV showed limited and context-dependent associations, emerging only for executive function in participants off medications affecting heart rate when measured during sedentary periods. Sleep duration variability was not associated with cognition, suggesting that coarse wearable-derived variability metrics may not adequately capture sleep features relevant to cognitive aging. Overall, results support the promise of select passive mobility metrics for cognitive screening while underscoring the need for more refined, context-sensitive digital phenotyping approaches.
- Open Access
- 7 January 2026
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 9, e82092
The Virtual Kitchen Challenge—Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults
Background: Conventional methods of functional assessment include subjective self- or informant report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (eg, influence of idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self- or informant reports but are time-consuming to administer and score. Objective: This study aims to evaluate the validity and reliability of the Virtual Kitchen Challenge—Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. Methods: A total of 236 community-dwelling, diverse older adults completed a comprehensive neuropsychological evaluation to classify cognitive status as healthy, mild cognitive impairment, or mild dementia, after adjustment for demographic variables (age, education, sex, and estimated IQ). Participants completed 2 everyday tasks (breakfast and lunch) in a virtual kitchen (VKC-2) using a touchscreen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (eg, number of screen interactions, percentage of time spent off-screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen). All participants and informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n=143) performed the VKC-2 again in a second session, 4-6 weeks after the baseline, for retest analyses. Analyses evaluated construct and convergent validity, as well as retest and internal reliability, of VKC-2 automated scores. Results: A principal component analysis showed that the primary VKC-2 automated scores captured a single dimension and could be combined into a composite score reflecting task efficiency. Construct validity was supported by analyses of covariance results showing that participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all Ps<.001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r=−0.58 to 0.64, Ps<.001), conventional cognitive test scores (r=−0.50 to −0.22, Ps<.001), and self- and informant report questionnaires evaluating everyday function (r=0.25 to 0.43, Ps<.001). Intraclass correlation coefficients (ICCs) indicated moderate to excellent retest reliability (ICC=0.70-0.90) for VKC-2 scores after 4-6 weeks. Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast and lunch) for all scores (0.77-0.84), supporting the use of total scores. Conclusions: The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults and holds promise to improve the status quo of functional assessment in aging, particularly when informants are unavailable or unreliable.
- 7 January 2026
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 9, e82092
Open AccessThe Virtual Kitchen Challenge—Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults
Background: Conventional methods of functional assessment include subjective self- or informant report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (eg, influence of idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self- or informant reports but are time-consuming to administer and score. Objective: This study aims to evaluate the validity and reliability of the Virtual Kitchen Challenge—Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. Methods: A total of 236 community-dwelling, diverse older adults completed a comprehensive neuropsychological evaluation to classify cognitive status as healthy, mild cognitive impairment, or mild dementia, after adjustment for demographic variables (age, education, sex, and estimated IQ). Participants completed 2 everyday tasks (breakfast and lunch) in a virtual kitchen (VKC-2) using a touchscreen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (eg, number of screen interactions, percentage of time spent off-screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen). All participants and informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n=143) performed the VKC-2 again in a second session, 4-6 weeks after the baseline, for retest analyses. Analyses evaluated construct and convergent validity, as well as retest and internal reliability, of VKC-2 automated scores. Results: A principal component analysis showed that the primary VKC-2 automated scores captured a single dimension and could be combined into a composite score reflecting task efficiency. Construct validity was supported by analyses of covariance results showing that participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all Ps<.001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r=−0.58 to 0.64, Ps<.001), conventional cognitive test scores (r=−0.50 to −0.22, Ps<.001), and self- and informant report questionnaires evaluating everyday function (r=0.25 to 0.43, Ps<.001). Intraclass correlation coefficients (ICCs) indicated moderate to excellent retest reliability (ICC=0.70-0.90) for VKC-2 scores after 4-6 weeks. Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast and lunch) for all scores (0.77-0.84), supporting the use of total scores. Conclusions: The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults and holds promise to improve the status quo of functional assessment in aging, particularly when informants are unavailable or unreliable.
- 29 December 2025
- Published by Taylor & Francis in Aging & Mental Health
- Vol. 30 (6) , 1351-1360
Bidirectional associations of daily mood and subjective cognition in older adults using Ecological Momentary Assessment
Depressive symptoms and subjective cognition are linked in older adults, but traditional measures have numerous limitations that may be addressed by ecological momentary assessment (EMA). This study examined whether baseline depressive and cognitive measures correspond to daily EMA ratings and evaluated concurrent and lagged relations between mood and subjective cognition. Fifty-five community-dwelling older adults (31% Black/African American; 44 cognitively healthy, 11 mild cognitive impairment) completed a four-week daily EMA survey assessing mood and subjective cognition. Baseline measures included a global cognitive composite and self-reported depressive symptoms, functional independence, and cognitive decline. Cumulative link mixed models examined associations between baseline and EMA measures and concurrent and lagged EMA relations. EMA mood correlated with baseline depressive symptoms, while EMA subjective cognition was most strongly associated with functional independence rather than objective cognition or self-reported cognitive decline. EMA mood and cognition were reciprocally associated concurrently. In lagged models, worse EMA subjective cognition predicted worse next-day mood, whereas the reverse association was not statistically significant. Lagged effects were attenuated after accounting for temporal trends and prior-day EMA values. EMA provides low-burden insights into mood and subjective cognition, supporting its utility for naturalistic assessment in older adults.
- 29 December 2025
- Published by Taylor & Francis in Aging & Mental Health
- Vol. 30 (6) , 1351-1360
Bidirectional associations of daily mood and subjective cognition in older adults using Ecological Momentary Assessment
Depressive symptoms and subjective cognition are linked in older adults, but traditional measures have numerous limitations that may be addressed by ecological momentary assessment (EMA). This study examined whether baseline depressive and cognitive measures correspond to daily EMA ratings and evaluated concurrent and lagged relations between mood and subjective cognition. Fifty-five community-dwelling older adults (31% Black/African American; 44 cognitively healthy, 11 mild cognitive impairment) completed a four-week daily EMA survey assessing mood and subjective cognition. Baseline measures included a global cognitive composite and self-reported depressive symptoms, functional independence, and cognitive decline. Cumulative link mixed models examined associations between baseline and EMA measures and concurrent and lagged EMA relations. EMA mood correlated with baseline depressive symptoms, while EMA subjective cognition was most strongly associated with functional independence rather than objective cognition or self-reported cognitive decline. EMA mood and cognition were reciprocally associated concurrently. In lagged models, worse EMA subjective cognition predicted worse next-day mood, whereas the reverse association was not statistically significant. Lagged effects were attenuated after accounting for temporal trends and prior-day EMA values. EMA provides low-burden insights into mood and subjective cognition, supporting its utility for naturalistic assessment in older adults.
- Open Access
- 25 December 2025
- Published by Wiley in Alzheimer's & Dementia
- Vol. 21 (S3) , e104567
Beyond single time point self‐report: EMA as a tool for understanding mood and cognition in older adults without dementia
Background: Depressive symptoms are strongly linked to self‐reported cognitive decline in older adults. Gold‐standard assessments of depression and functional abilities are typically measured at one time point, but EMA can efficiently capture overall and fluctuations in daily mood and subjective cognition. Understanding daily fluctuations and interactions among mood and cognition may reveal patterns missed by gold‐standard assessment. This study sought to explore the relations among cognition, daily EMA mood and subjective cognition, and conventional self‐report measures of depression and function. Method: Fifty‐five community dwelling older adults with healthy cognition ( n = 45; 30.9% Black/African American) or mild cognitive impairment (MCI; n = 10) completed a daily EMA smartphone‐based survey for 30 days that assessed self‐reported mood (happy, neutral, sad) and subjective cognition (very sharp, neutral, not sharp). EMA metrics were converted to percentages of total days of EMA data. Baseline measures included global and domain cognitive composites computed from demographically‐ adjusted cognitive tests, self‐reported depression [Geriatric Depression Scale‐15 (GDS)], cognitive decline [Measurement of Everyday Cognition (Ecog)], and function [Functional Activities Questionnaire (FAQ)]. Spearman correlations were run to examine relations among EMA mood, subjective cognition, conventional tests of cognition, and self‐reported baseline depression and cognitive decline. Result: Lower percent of “happy” days and greater percent of “neutral” mood days were related to higher GDS (ρ = ‐.385, p = .004; ρ = .416, p = .002). Neither EMA mood ratings nor the GDS were related to the cognitive composite. A greater percent of “not sharp” days was related to greater self‐reported cognitive decline and functional difficulties (FAQ and Ecog) (ρ = .357, p = .009; ρ = .309, p = .002). Greater percent of “not sharp” days (and ECog) were significantly associated with a lower cognitive composite (ρ=‐.279, p = .039; ρ=‐.319, p = .018) and higher GDS score (ρ = .408, p = .002; ρ = .384, p = .004) Conclusion: Daily EMA mood and subjective cognition measures were significantly related to conventional clinical measures of mood, cognitive decline, and everyday function in expected directions. Subjective cognition (EMA and conventional measures) but not mood (EMA and GDS) was related to objective cognition. Results support the validity of conventional self‐report measures and suggest EMA is a valid method for assessing older adults’ mood and cognition “in the wild”.
- 25 December 2025
- Published by Wiley in Alzheimer's & Dementia
- Vol. 21 (S3) , e104567
Open AccessBeyond single time point self‐report: EMA as a tool for understanding mood and cognition in older adults without dementia
Background: Depressive symptoms are strongly linked to self‐reported cognitive decline in older adults. Gold‐standard assessments of depression and functional abilities are typically measured at one time point, but EMA can efficiently capture overall and fluctuations in daily mood and subjective cognition. Understanding daily fluctuations and interactions among mood and cognition may reveal patterns missed by gold‐standard assessment. This study sought to explore the relations among cognition, daily EMA mood and subjective cognition, and conventional self‐report measures of depression and function. Method: Fifty‐five community dwelling older adults with healthy cognition ( n = 45; 30.9% Black/African American) or mild cognitive impairment (MCI; n = 10) completed a daily EMA smartphone‐based survey for 30 days that assessed self‐reported mood (happy, neutral, sad) and subjective cognition (very sharp, neutral, not sharp). EMA metrics were converted to percentages of total days of EMA data. Baseline measures included global and domain cognitive composites computed from demographically‐ adjusted cognitive tests, self‐reported depression [Geriatric Depression Scale‐15 (GDS)], cognitive decline [Measurement of Everyday Cognition (Ecog)], and function [Functional Activities Questionnaire (FAQ)]. Spearman correlations were run to examine relations among EMA mood, subjective cognition, conventional tests of cognition, and self‐reported baseline depression and cognitive decline. Result: Lower percent of “happy” days and greater percent of “neutral” mood days were related to higher GDS (ρ = ‐.385, p = .004; ρ = .416, p = .002). Neither EMA mood ratings nor the GDS were related to the cognitive composite. A greater percent of “not sharp” days was related to greater self‐reported cognitive decline and functional difficulties (FAQ and Ecog) (ρ = .357, p = .009; ρ = .309, p = .002). Greater percent of “not sharp” days (and ECog) were significantly associated with a lower cognitive composite (ρ=‐.279, p = .039; ρ=‐.319, p = .018) and higher GDS score (ρ = .408, p = .002; ρ = .384, p = .004) Conclusion: Daily EMA mood and subjective cognition measures were significantly related to conventional clinical measures of mood, cognitive decline, and everyday function in expected directions. Subjective cognition (EMA and conventional measures) but not mood (EMA and GDS) was related to objective cognition. Results support the validity of conventional self‐report measures and suggest EMA is a valid method for assessing older adults’ mood and cognition “in the wild”.
- Open Access
The Virtual Kitchen Challenge–Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults
Background: Conventional methods of functional assessment include subjective self/informant-report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (e.g., influenced by idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self/informant reports, but they are time consuming to administer and score. Objective: To evaluate the validity and reliability of the Virtual Kitchen Challenge -Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. Methods: 236 community-dwelling diverse older adults completed a comprehensive neuropsychological evaluation to classify their cognitive abilities as healthy, mild cognitive impairment or mild dementia, after adjustment of demographic variables (age, education, sex, estimated IQ). Participants were administered the VKC-2, which required completion of two everyday tasks (breakfast, lunch) in a virtual kitchen using a touch-screen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (e.g., number of screen interactions, % time spent off screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen) and questionnaires of everyday function. Informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n = 143) performed the VKC-2 again in a second session 4-6 weeks after the baseline for retest analyses. Analyses evaluated construct and convergent validity and retest and internal reliability of VKC-2 automated scores. Results: Construct validity was supported by ANCOVA results showing participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all ps < .001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r values = -.58 to .64, ps < .001), conventional cognitive test scores (r values = -.50 to -.22, ps < .001), and to self and informant questionnaires evaluating everyday function (r values = .25 to .43, ps < .001). Retest reliability was strong as evidenced by high intraclass correlations between VKC-2 scores across the two timepoints (κ = 0.27, p < .001). Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast, lunch) for all scores (.77 to .81) supporting the use of total scores. Conclusions: The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults that may be used for large scale longitudinal studies, clinical trials, and clinical assessments. The VKC-2 holds promise to improve the status quo of functional assessment in aging particularly when informants are unavailable or unreliable.
Open AccessThe Virtual Kitchen Challenge–Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults
Background: Conventional methods of functional assessment include subjective self/informant-report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (e.g., influenced by idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self/informant reports, but they are time consuming to administer and score. Objective: To evaluate the validity and reliability of the Virtual Kitchen Challenge -Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. Methods: 236 community-dwelling diverse older adults completed a comprehensive neuropsychological evaluation to classify their cognitive abilities as healthy, mild cognitive impairment or mild dementia, after adjustment of demographic variables (age, education, sex, estimated IQ). Participants were administered the VKC-2, which required completion of two everyday tasks (breakfast, lunch) in a virtual kitchen using a touch-screen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (e.g., number of screen interactions, % time spent off screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen) and questionnaires of everyday function. Informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n = 143) performed the VKC-2 again in a second session 4-6 weeks after the baseline for retest analyses. Analyses evaluated construct and convergent validity and retest and internal reliability of VKC-2 automated scores. Results: Construct validity was supported by ANCOVA results showing participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all ps < .001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r values = -.58 to .64, ps < .001), conventional cognitive test scores (r values = -.50 to -.22, ps < .001), and to self and informant questionnaires evaluating everyday function (r values = .25 to .43, ps < .001). Retest reliability was strong as evidenced by high intraclass correlations between VKC-2 scores across the two timepoints (κ = 0.27, p < .001). Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast, lunch) for all scores (.77 to .81) supporting the use of total scores. Conclusions: The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults that may be used for large scale longitudinal studies, clinical trials, and clinical assessments. The VKC-2 holds promise to improve the status quo of functional assessment in aging particularly when informants are unavailable or unreliable.
- Open Access
- 12 August 2025
- Published by JMIR Publications Inc. in JMIR Preprints
The Virtual Kitchen Challenge—Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults (Preprint)
BACKGROUND Conventional methods of functional assessment include subjective self- or informant report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (eg, influence of idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self- or informant reports but are time-consuming to administer and score. OBJECTIVE This study aims to evaluate the validity and reliability of the Virtual Kitchen Challenge—Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. METHODS A total of 236 community-dwelling, diverse older adults completed a comprehensive neuropsychological evaluation to classify cognitive status as healthy, mild cognitive impairment, or mild dementia, after adjustment for demographic variables (age, education, sex, and estimated IQ). Participants completed 2 everyday tasks (breakfast and lunch) in a virtual kitchen (VKC-2) using a touchscreen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (eg, number of screen interactions, percentage of time spent off-screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen). All participants and informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n=143) performed the VKC-2 again in a second session, 4-6 weeks after the baseline, for retest analyses. Analyses evaluated construct and convergent validity, as well as retest and internal reliability, of VKC-2 automated scores. RESULTS A principal component analysis showed that the primary VKC-2 automated scores captured a single dimension and could be combined into a composite score reflecting task efficiency. Construct validity was supported by analyses of covariance results showing that participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all Ps<.001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r=−0.58 to 0.64, Ps<.001), conventional cognitive test scores (r=−0.50 to −0.22, Ps<.001), and self- and informant report questionnaires evaluating everyday function (r=0.25 to 0.43, Ps<.001). Intraclass correlation coefficients (ICCs) indicated moderate to excellent retest reliability (ICC=0.70-0.90) for VKC-2 scores after 4-6 weeks. Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast and lunch) for all scores (0.77-0.84), supporting the use of total scores. CONCLUSIONS The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults and holds promise to improve the status quo of functional assessment in aging, particularly when informants are unavailable or unreliable.
- 12 August 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessThe Virtual Kitchen Challenge—Version 2: Validation of a Digital Assessment of Everyday Function in Older Adults (Preprint)
BACKGROUND Conventional methods of functional assessment include subjective self- or informant report, which may be biased by personal characteristics, cognitive abilities, and lack of standardization (eg, influence of idiosyncratic task demands). Traditional performance-based assessments offer some advantages over self- or informant reports but are time-consuming to administer and score. OBJECTIVE This study aims to evaluate the validity and reliability of the Virtual Kitchen Challenge—Version 2 (VKC-2), an objective, standardized, and highly efficient alternative to current functional assessments for older adults across the spectrum of cognitive aging, from preclinical to mild dementia. METHODS A total of 236 community-dwelling, diverse older adults completed a comprehensive neuropsychological evaluation to classify cognitive status as healthy, mild cognitive impairment, or mild dementia, after adjustment for demographic variables (age, education, sex, and estimated IQ). Participants completed 2 everyday tasks (breakfast and lunch) in a virtual kitchen (VKC-2) using a touchscreen interface to select objects and sequence steps. Automated scoring reflected completion time and performance efficiency (eg, number of screen interactions, percentage of time spent off-screen, interactions with distractor objects). Participants also completed the VKC-2 tasks using real objects (Real Kitchen). All participants and informants for 219 participants completed questionnaires regarding everyday function. A subsample of participants (n=143) performed the VKC-2 again in a second session, 4-6 weeks after the baseline, for retest analyses. Analyses evaluated construct and convergent validity, as well as retest and internal reliability, of VKC-2 automated scores. RESULTS A principal component analysis showed that the primary VKC-2 automated scores captured a single dimension and could be combined into a composite score reflecting task efficiency. Construct validity was supported by analyses of covariance results showing that participants with healthy cognition obtained significantly better VKC-2 scores than participants with cognitive impairment (all Ps<.001), even after controlling for demographics and general computer visuomotor dexterity. Convergent validity was supported by significant correlations between VKC-2 scores and performance on the Real Kitchen (r=−0.58 to 0.64, Ps<.001), conventional cognitive test scores (r=−0.50 to −0.22, Ps<.001), and self- and informant report questionnaires evaluating everyday function (r=0.25 to 0.43, Ps<.001). Intraclass correlation coefficients (ICCs) indicated moderate to excellent retest reliability (ICC=0.70-0.90) for VKC-2 scores after 4-6 weeks. Reliability improved in analyses including only participants who reported no change in cognitive status between time 1 and time 2 (n=123). Spearman-Brown correlations showed acceptable to good internal consistency between the VKC-2 tasks (breakfast and lunch) for all scores (0.77-0.84), supporting the use of total scores. CONCLUSIONS The VKC-2 is an efficient, valid, and sensitive measure of everyday function for diverse older adults and holds promise to improve the status quo of functional assessment in aging, particularly when informants are unavailable or unreliable.
- 30 April 2025
- Published by Taylor & Francis in The Clinical Neuropsychologist
- Vol. 40 (1) , 183-202
Subtle inefficiencies in everyday tasks indicate early functional difficulties in older adults: Implications for clinical practice and research
Objectives: This study investigated the validity and reliability of subtle errors and slowing in simple everyday tasks (Naturalistic Action Test [NAT]) to assess mild functional difficulties in older adults with mild cognitive impairmen (MCI). Method: Older adults (N = 111, MAge= 73.45; SD= 6.53) classified as having healthy cognition (HC) or MCI completed neuropsychological testing and two NAT tasks (breakfast and lunch) twice, separated by 4-6 wk. NATs were scored for subtle, inefficient actions (i.e., micro-errors) and the average time (in sec) to complete a task step. Results: Participants with MCI made significantly more micro-errors [F (1, 109) = 8.78, p = .004, partial η2 = 0.07] and had a significantly longer average time per step [F (1, 109) = 13.98, p < .001, partial η2 = 0.11] than participants with HC. Micro-errors correlated with tests of episodic memory (r = -0.237, p = .012) and executive functioning (r = -0.201, p = .035), whereas average time per step correlated only with episodic memory (r = -0.300, p = .0001). Test-retest reliability was good for average time per step (ICC = .872, p < .001) and moderate for micro-errors (ICC = .675, p < .001). Conclusions: Measures of inefficient actions and performance time in familiar everyday tasks demonstrated strong to adequate construct and concurrent validity, as well as test-retest- and inter-rater reliability, supporting their use for the quantifying mild functional difficulties. Future studies should explore this scoring approach to develop early markers of functional disability or dementia risk.
- 30 April 2025
- Published by Taylor & Francis in The Clinical Neuropsychologist
- Vol. 40 (1) , 183-202
Subtle inefficiencies in everyday tasks indicate early functional difficulties in older adults: Implications for clinical practice and research
Objectives: This study investigated the validity and reliability of subtle errors and slowing in simple everyday tasks (Naturalistic Action Test [NAT]) to assess mild functional difficulties in older adults with mild cognitive impairmen (MCI). Method: Older adults (N = 111, MAge= 73.45; SD= 6.53) classified as having healthy cognition (HC) or MCI completed neuropsychological testing and two NAT tasks (breakfast and lunch) twice, separated by 4-6 wk. NATs were scored for subtle, inefficient actions (i.e., micro-errors) and the average time (in sec) to complete a task step. Results: Participants with MCI made significantly more micro-errors [F (1, 109) = 8.78, p = .004, partial η2 = 0.07] and had a significantly longer average time per step [F (1, 109) = 13.98, p < .001, partial η2 = 0.11] than participants with HC. Micro-errors correlated with tests of episodic memory (r = -0.237, p = .012) and executive functioning (r = -0.201, p = .035), whereas average time per step correlated only with episodic memory (r = -0.300, p = .0001). Test-retest reliability was good for average time per step (ICC = .872, p < .001) and moderate for micro-errors (ICC = .675, p < .001). Conclusions: Measures of inefficient actions and performance time in familiar everyday tasks demonstrated strong to adequate construct and concurrent validity, as well as test-retest- and inter-rater reliability, supporting their use for the quantifying mild functional difficulties. Future studies should explore this scoring approach to develop early markers of functional disability or dementia risk.
- Open Access
- 8 April 2025
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 12 (1) , e69952
Longitudinal and Combined Smartwatch and Ecological Momentary Assessment in Racially Diverse Older Adults: Feasibility, Adherence, and Acceptability Study
Background: Due to the rising prevalence of Alzheimer disease and related dementias, easily deployable tools to quantify risk are needed. Smartphones and smartwatches enable unobtrusive and continuous monitoring, but there is limited information regarding the feasibility, adherence, and acceptability of digital data collection among racially diverse older adults. Objective: This paper examined the feasibility, adherence, and acceptability of a 4-week combined smartwatch monitoring and ecological momentary assessment (EMA) study in a racially diverse sample of older adults. Methods: A total of 44 older adults (aged ≥55 y) with either mild cognitive impairment or healthy cognition completed an informed consent comprehension quiz, baseline cognitive testing, training regarding digital data collection, and questionnaires. Participants were instructed to wear a Garmin Vivosmart 4 smartwatch for 23 h/d for 4 weeks, sync 2 smartphone apps (Garmin and Labfront) daily, and complete a daily EMA survey with automated prompts for surveys and charging. Training time, smartwatch adherence (eg, wear time), daily EMA survey response rate, and performance on the consent quiz were quantified. Associations between feasibility and adherence metrics and participant factors were evaluated. Self-reported usability of the apps and smartwatch was collected at study end. Results: Consent comprehension quiz scores were high (mean 97.33%, SD 6.86% correct), and training sessions lasted on average 17.93 (SD 6.89) minutes. During the 4-week study, participants wore the smartwatch for an average of 21 h/d (SD 1.53) and showed an average response rate of 94% (SD 9.58%) to daily EMA surveys. In unadjusted bivariate analyses, age, race, and cognition were associated with feasibility and adherence measures, but only age and race remained significant in multivariate models. After accounting for all participant factors, older age was a significant predictor of longer training time, and Black race was a significant predictor of lower daily wear time. On the usability survey, all participants (45/45, 100%) indicated willingness to participate in future smartwatch studies, >80% (37/45) had a positive experience, and >90% (41/45) were satisfied with smartphone app syncing. Conclusions: Smartwatch monitoring, requiring daily wear, smartphone syncing, and daily EMA survey completion, is highly feasible in older adults because adherence to daily wear and EMA surveys was high, as was general satisfaction on usability surveys. Although older participants may require more training on smartwatch and smartphone procedures and automated prompting during the study period, longitudinal monitoring with the Garmin Vivosmart 4 smartwatch and Labfront app is acceptable and feasible for collecting nearly continuous data in Black and White older adults, including those with mild cognitive impairment and those without.
- 8 April 2025
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 12 (1) , e69952
Open AccessLongitudinal and Combined Smartwatch and Ecological Momentary Assessment in Racially Diverse Older Adults: Feasibility, Adherence, and Acceptability Study
Background: Due to the rising prevalence of Alzheimer disease and related dementias, easily deployable tools to quantify risk are needed. Smartphones and smartwatches enable unobtrusive and continuous monitoring, but there is limited information regarding the feasibility, adherence, and acceptability of digital data collection among racially diverse older adults. Objective: This paper examined the feasibility, adherence, and acceptability of a 4-week combined smartwatch monitoring and ecological momentary assessment (EMA) study in a racially diverse sample of older adults. Methods: A total of 44 older adults (aged ≥55 y) with either mild cognitive impairment or healthy cognition completed an informed consent comprehension quiz, baseline cognitive testing, training regarding digital data collection, and questionnaires. Participants were instructed to wear a Garmin Vivosmart 4 smartwatch for 23 h/d for 4 weeks, sync 2 smartphone apps (Garmin and Labfront) daily, and complete a daily EMA survey with automated prompts for surveys and charging. Training time, smartwatch adherence (eg, wear time), daily EMA survey response rate, and performance on the consent quiz were quantified. Associations between feasibility and adherence metrics and participant factors were evaluated. Self-reported usability of the apps and smartwatch was collected at study end. Results: Consent comprehension quiz scores were high (mean 97.33%, SD 6.86% correct), and training sessions lasted on average 17.93 (SD 6.89) minutes. During the 4-week study, participants wore the smartwatch for an average of 21 h/d (SD 1.53) and showed an average response rate of 94% (SD 9.58%) to daily EMA surveys. In unadjusted bivariate analyses, age, race, and cognition were associated with feasibility and adherence measures, but only age and race remained significant in multivariate models. After accounting for all participant factors, older age was a significant predictor of longer training time, and Black race was a significant predictor of lower daily wear time. On the usability survey, all participants (45/45, 100%) indicated willingness to participate in future smartwatch studies, >80% (37/45) had a positive experience, and >90% (41/45) were satisfied with smartphone app syncing. Conclusions: Smartwatch monitoring, requiring daily wear, smartphone syncing, and daily EMA survey completion, is highly feasible in older adults because adherence to daily wear and EMA surveys was high, as was general satisfaction on usability surveys. Although older participants may require more training on smartwatch and smartphone procedures and automated prompting during the study period, longitudinal monitoring with the Garmin Vivosmart 4 smartwatch and Labfront app is acceptable and feasible for collecting nearly continuous data in Black and White older adults, including those with mild cognitive impairment and those without.
- Open Access
- 11 December 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Longitudinal and Combined Smartwatch and Ecological Momentary Assessment in Racially Diverse Older Adults: Feasibility, Adherence, and Acceptability Study (Preprint)
BACKGROUND Due to the rising prevalence of Alzheimer disease and related dementias, easily deployable tools to quantify risk are needed. Smartphones and smartwatches enable unobtrusive and continuous monitoring, but there is limited information regarding the feasibility, adherence, and acceptability of digital data collection among racially diverse older adults. OBJECTIVE This paper examined the feasibility, adherence, and acceptability of a 4-week combined smartwatch monitoring and ecological momentary assessment (EMA) study in a racially diverse sample of older adults. METHODS A total of 44 older adults (aged ≥55 y) with either mild cognitive impairment or healthy cognition completed an informed consent comprehension quiz, baseline cognitive testing, training regarding digital data collection, and questionnaires. Participants were instructed to wear a Garmin Vivosmart 4 smartwatch for 23 h/d for 4 weeks, sync 2 smartphone apps (Garmin and Labfront) daily, and complete a daily EMA survey with automated prompts for surveys and charging. Training time, smartwatch adherence (eg, wear time), daily EMA survey response rate, and performance on the consent quiz were quantified. Associations between feasibility and adherence metrics and participant factors were evaluated. Self-reported usability of the apps and smartwatch was collected at study end. RESULTS Consent comprehension quiz scores were high (mean 97.33%, SD 6.86% correct), and training sessions lasted on average 17.93 (SD 6.89) minutes. During the 4-week study, participants wore the smartwatch for an average of 21 h/d (SD 1.53) and showed an average response rate of 94% (SD 9.58%) to daily EMA surveys. In unadjusted bivariate analyses, age, race, and cognition were associated with feasibility and adherence measures, but only age and race remained significant in multivariate models. After accounting for all participant factors, older age was a significant predictor of longer training time, and Black race was a significant predictor of lower daily wear time. On the usability survey, all participants (45/45, 100%) indicated willingness to participate in future smartwatch studies, >80% (37/45) had a positive experience, and >90% (41/45) were satisfied with smartphone app syncing. CONCLUSIONS Smartwatch monitoring, requiring daily wear, smartphone syncing, and daily EMA survey completion, is highly feasible in older adults because adherence to daily wear and EMA surveys was high, as was general satisfaction on usability surveys. Although older participants may require more training on smartwatch and smartphone procedures and automated prompting during the study period, longitudinal monitoring with the Garmin Vivosmart 4 smartwatch and Labfront app is acceptable and feasible for collecting nearly continuous data in Black and White older adults, including those with mild cognitive impairment and those without.
- 11 December 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessLongitudinal and Combined Smartwatch and Ecological Momentary Assessment in Racially Diverse Older Adults: Feasibility, Adherence, and Acceptability Study (Preprint)
BACKGROUND Due to the rising prevalence of Alzheimer disease and related dementias, easily deployable tools to quantify risk are needed. Smartphones and smartwatches enable unobtrusive and continuous monitoring, but there is limited information regarding the feasibility, adherence, and acceptability of digital data collection among racially diverse older adults. OBJECTIVE This paper examined the feasibility, adherence, and acceptability of a 4-week combined smartwatch monitoring and ecological momentary assessment (EMA) study in a racially diverse sample of older adults. METHODS A total of 44 older adults (aged ≥55 y) with either mild cognitive impairment or healthy cognition completed an informed consent comprehension quiz, baseline cognitive testing, training regarding digital data collection, and questionnaires. Participants were instructed to wear a Garmin Vivosmart 4 smartwatch for 23 h/d for 4 weeks, sync 2 smartphone apps (Garmin and Labfront) daily, and complete a daily EMA survey with automated prompts for surveys and charging. Training time, smartwatch adherence (eg, wear time), daily EMA survey response rate, and performance on the consent quiz were quantified. Associations between feasibility and adherence metrics and participant factors were evaluated. Self-reported usability of the apps and smartwatch was collected at study end. RESULTS Consent comprehension quiz scores were high (mean 97.33%, SD 6.86% correct), and training sessions lasted on average 17.93 (SD 6.89) minutes. During the 4-week study, participants wore the smartwatch for an average of 21 h/d (SD 1.53) and showed an average response rate of 94% (SD 9.58%) to daily EMA surveys. In unadjusted bivariate analyses, age, race, and cognition were associated with feasibility and adherence measures, but only age and race remained significant in multivariate models. After accounting for all participant factors, older age was a significant predictor of longer training time, and Black race was a significant predictor of lower daily wear time. On the usability survey, all participants (45/45, 100%) indicated willingness to participate in future smartwatch studies, >80% (37/45) had a positive experience, and >90% (41/45) were satisfied with smartphone app syncing. CONCLUSIONS Smartwatch monitoring, requiring daily wear, smartphone syncing, and daily EMA survey completion, is highly feasible in older adults because adherence to daily wear and EMA surveys was high, as was general satisfaction on usability surveys. Although older participants may require more training on smartwatch and smartphone procedures and automated prompting during the study period, longitudinal monitoring with the Garmin Vivosmart 4 smartwatch and Labfront app is acceptable and feasible for collecting nearly continuous data in Black and White older adults, including those with mild cognitive impairment and those without.
- Open Access
- 1 January 2024
- Published by Wiley in Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring
- Vol. 16 (1) , e12547
Preliminary validation of the Virtual Kitchen Challenge as an objective and sensitive measure of everyday function associated with cerebrovascular disease
Preliminary validity of a computer‐based test of everyday function (Virtual Kitchen Challenge [VKC]) was examined against brain‐imaging markers of cerebrovascular disease and in contrast to conventional neuropsychological and self‐report measures. Twenty community‐dwelling older adults (n = 6 mild cognitive impairment) performed simulated breakfast and lunch tasks using a computer touchscreen (VKC). Automated measures (completion time, proportion time off screen, etc.) were computed during training and test conditions. White matter hyperintensity (WMH) volumes from brain magnetic resonance imaging and conventional measures of cognition and function also were obtained. VKC completion time and proportion time off screen improved significantly from training to test and were significantly associated with WMH volume (r > 0.573). VKC measures and WMH were not significantly correlated with conventional cognitive or self‐report measures. The VKC holds promise as a valid measure of subtle functional difficulties in older adults that is sensitive to change and cerebrovascular pathology, highlighting its potential for clinical trials.Highlights: Virtual Kitchen Challenge (VKC) scores showed significant improvement from training to test conditions. VKC scores (completion time and proportion of time off screen) were associated with a neuroimaging biomarker of brain health (white matter hyperintensities).
- 1 January 2024
- Published by Wiley in Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring
- Vol. 16 (1) , e12547
Open AccessPreliminary validation of the Virtual Kitchen Challenge as an objective and sensitive measure of everyday function associated with cerebrovascular disease
Preliminary validity of a computer‐based test of everyday function (Virtual Kitchen Challenge [VKC]) was examined against brain‐imaging markers of cerebrovascular disease and in contrast to conventional neuropsychological and self‐report measures. Twenty community‐dwelling older adults (n = 6 mild cognitive impairment) performed simulated breakfast and lunch tasks using a computer touchscreen (VKC). Automated measures (completion time, proportion time off screen, etc.) were computed during training and test conditions. White matter hyperintensity (WMH) volumes from brain magnetic resonance imaging and conventional measures of cognition and function also were obtained. VKC completion time and proportion time off screen improved significantly from training to test and were significantly associated with WMH volume (r > 0.573). VKC measures and WMH were not significantly correlated with conventional cognitive or self‐report measures. The VKC holds promise as a valid measure of subtle functional difficulties in older adults that is sensitive to change and cerebrovascular pathology, highlighting its potential for clinical trials.Highlights: Virtual Kitchen Challenge (VKC) scores showed significant improvement from training to test conditions. VKC scores (completion time and proportion of time off screen) were associated with a neuroimaging biomarker of brain health (white matter hyperintensities).