Robin C. Hilsabeck
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Robin C. Hilsabeck has a total of 133 co-authors. Here are the top co-authors by number of shared publications:
- Alyssa Aguirre
Department of Neurology and Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, USA
8 shared publications - Bo Xie
School of Nursing, The University of Texas at Austin, Austin, TX, United States
5 shared publications Suzanne Schmitz
Department of Neurology, The University of Texas at Austin Dell Medical School , Austin, TX 78201
5 shared publications- Daqing He
Department of Informatics and Networked Systems, School of Computing and Information, University of Pittsburgh, Pittsburgh, PA, United States
3 shared publications Heather Foil
Institute of Dementia Research & Prevention Pennington Biomedical Research Center at Louisiana State University Baton Rouge Louisiana USA
3 shared publications- Monica Rivera Mindt
Department of Psychology, Fordham University, Bronx, NY 10458, USA
3 shared publications
Latest Publications
- Open Access
- 19 October 2026
- Published by SAGE Publications in Journal of Geriatric Psychiatry and Neurology
Evaluating a Two-Step Approach: Combining Brief Risk Indicators and Short Cognitive Assessments for Improving Early Detection of Cognitive Impairment
Background: Scalable approaches for early detection of cognitive impairment are urgently needed. A two-step screening approach, in which short cognitive assessments are administered only to individuals at risk, offers an efficient alternative to universal screening. This study evaluated combinations of brief self-report risk indicators and short cognitive assessments to identify models that accurately classify cognitive impairment. Methods: Participants aged 60+ from dementia specialty settings were classified as cognitively normal (CN; n = 87) or cognitively impaired (CI; n = 66). All completed three risk indicators, a modified self-report Brief Dementia Screening Indicator (BDSI), self-report of personal memory concerns, self-report of memory concerns expressed by others (other concern), and two short cognitive assessments (Quick Mild Cognitive Impairment screen [Qmci] and Speeded Matching [SM]). Logistic regressions using continuous variables and composite binary predictors predicted cognitive status. Results: Models significantly predicted cognitive status ( P < .001; AUCs = 0.84-0.91 for continuous models and 0.59-0.79 for composite models). Among risk indicators, the BDSI was least informative, while other concern was the strongest predictor. Qmci and SM performed comparably as continuous variables. The best-performing composite predictor derived from other concern and Qmci yielded OR = 28.70 ( P < .001), sensitivity = 63.6%, specificity = 94.3%. Conclusion: A two-step approach using brief self-report risk indicators and short cognitive assessments shows promise for efficient detection of cognitive impairment, providing initial validation in dementia specialty settings to support evaluation in primary care.
- 19 October 2026
- Published by SAGE Publications in Journal of Geriatric Psychiatry and Neurology
Open AccessEvaluating a Two-Step Approach: Combining Brief Risk Indicators and Short Cognitive Assessments for Improving Early Detection of Cognitive Impairment
Background: Scalable approaches for early detection of cognitive impairment are urgently needed. A two-step screening approach, in which short cognitive assessments are administered only to individuals at risk, offers an efficient alternative to universal screening. This study evaluated combinations of brief self-report risk indicators and short cognitive assessments to identify models that accurately classify cognitive impairment. Methods: Participants aged 60+ from dementia specialty settings were classified as cognitively normal (CN; n = 87) or cognitively impaired (CI; n = 66). All completed three risk indicators, a modified self-report Brief Dementia Screening Indicator (BDSI), self-report of personal memory concerns, self-report of memory concerns expressed by others (other concern), and two short cognitive assessments (Quick Mild Cognitive Impairment screen [Qmci] and Speeded Matching [SM]). Logistic regressions using continuous variables and composite binary predictors predicted cognitive status. Results: Models significantly predicted cognitive status ( P < .001; AUCs = 0.84-0.91 for continuous models and 0.59-0.79 for composite models). Among risk indicators, the BDSI was least informative, while other concern was the strongest predictor. Qmci and SM performed comparably as continuous variables. The best-performing composite predictor derived from other concern and Qmci yielded OR = 28.70 ( P < .001), sensitivity = 63.6%, specificity = 94.3%. Conclusion: A two-step approach using brief self-report risk indicators and short cognitive assessments shows promise for efficient detection of cognitive impairment, providing initial validation in dementia specialty settings to support evaluation in primary care.
- Open Access
- 1 April 2026
- Published by Wolters Kluwer Health in Alzheimer Disease & Associated Disorders
- Vol. 40 (2) , 157-161
Detecting Cognitive Impairment Early in Hispanic and Black Older Adults
Background: Alzheimer disease and related dementias (ADRD) are more prevalent in Black and Hispanic older adults and are also more likely to be undetected and misdiagnosed. The purpose of this study was to engage with Black and Hispanic communities about interest in and support needed for memory screening. Methods: Participants were recruited from established community partners of the South Texas Alzheimer’s Disease Research Center to engagein a 90-minute listening session. The session was recorded with participants’ permission, and a thematic analysis was conducted by 2 independent coders. Results: Sixteen individuals (81% female, 88% Hispanic or Black) from various perspectives participated (eg, health care workers, persons with dementia, caregivers). Four core themes emerged: building trust, access and time barriers, community-specific literature, and representative messengers. Trust was noted to be foundational, encompassing who delivers the screening and where it takes place. Transportation, time burden, competing caregiving responsibilities, work schedules, and limited access to technology/internet were key barriers. The need to create accessible and relatable literature and videos tailored to diverse educational levels and cultural backgrounds was also emphasized. Conclusions: Trusted members of the community could be accepted to perform memory screenings and provide education. Partnering with faith-based organizations, senior centers, and other community hubs would help overcome barriers to screening.
- 1 April 2026
- Published by Wolters Kluwer Health in Alzheimer Disease & Associated Disorders
- Vol. 40 (2) , 157-161
Open AccessDetecting Cognitive Impairment Early in Hispanic and Black Older Adults
Background: Alzheimer disease and related dementias (ADRD) are more prevalent in Black and Hispanic older adults and are also more likely to be undetected and misdiagnosed. The purpose of this study was to engage with Black and Hispanic communities about interest in and support needed for memory screening. Methods: Participants were recruited from established community partners of the South Texas Alzheimer’s Disease Research Center to engagein a 90-minute listening session. The session was recorded with participants’ permission, and a thematic analysis was conducted by 2 independent coders. Results: Sixteen individuals (81% female, 88% Hispanic or Black) from various perspectives participated (eg, health care workers, persons with dementia, caregivers). Four core themes emerged: building trust, access and time barriers, community-specific literature, and representative messengers. Trust was noted to be foundational, encompassing who delivers the screening and where it takes place. Transportation, time burden, competing caregiving responsibilities, work schedules, and limited access to technology/internet were key barriers. The need to create accessible and relatable literature and videos tailored to diverse educational levels and cultural backgrounds was also emphasized. Conclusions: Trusted members of the community could be accepted to perform memory screenings and provide education. Partnering with faith-based organizations, senior centers, and other community hubs would help overcome barriers to screening.
- 4 November 2025
- Published by Oxford University Press (OUP) in Archives of Clinical Neuropsychology
- Vol. 41 (2)
Validation of a Web-Based Digit Symbol Substitution Task for Detection of Mild Cognitive Impairment in Older Adults
Objective: Given the global aging of society and projected increases in cognitive impairment, rapid and sensitive cognitive screening tests are needed to facilitate early detection of mild cognitive impairment (MCI) in older adults. The purpose of this study was to explore the effectiveness of a web-based digit symbol substitution task, Speeded Matching (SM), including a second administration within-session to determine the added utility of practice effects, for potential use as a cognitive screening measure in older adult populations. Method: Forty-seven older adults with MCI and 87 cognitively normal controls (NC) completed SM twice on an iPad, as well as a brief paper-and-pencil cognitive screening test, the Quick MCI (Qmci). Receiver operating characteristic (ROC) curve analyses were used to investigate the classification accuracy of both administrations of the SM and the Qmci. The incremental validity of the second administration of SM was examined using logistic regression analysis. Results: Patients with MCI performed significantly worse than their NC counterparts on all measures. NC participants also demonstrated significantly greater practice effects than those with MCI. ROC curve analyses indicated that a cutoff score of <24 for the first administration (AUC = 0.82) and < 27 for the second administration (AUC = 0.85) of SM had slightly better classification accuracy than the Qmci (AUC = 0.77), and a second administration of the SM task within-session significantly improved overall classification accuracy. Conclusions: Findings suggest that a rapid web-based digit symbol substitution test is a valid screening measure that performs as well as a traditional cognitive screening test.
- 4 November 2025
- Published by Oxford University Press (OUP) in Archives of Clinical Neuropsychology
- Vol. 41 (2)
Validation of a Web-Based Digit Symbol Substitution Task for Detection of Mild Cognitive Impairment in Older Adults
Objective: Given the global aging of society and projected increases in cognitive impairment, rapid and sensitive cognitive screening tests are needed to facilitate early detection of mild cognitive impairment (MCI) in older adults. The purpose of this study was to explore the effectiveness of a web-based digit symbol substitution task, Speeded Matching (SM), including a second administration within-session to determine the added utility of practice effects, for potential use as a cognitive screening measure in older adult populations. Method: Forty-seven older adults with MCI and 87 cognitively normal controls (NC) completed SM twice on an iPad, as well as a brief paper-and-pencil cognitive screening test, the Quick MCI (Qmci). Receiver operating characteristic (ROC) curve analyses were used to investigate the classification accuracy of both administrations of the SM and the Qmci. The incremental validity of the second administration of SM was examined using logistic regression analysis. Results: Patients with MCI performed significantly worse than their NC counterparts on all measures. NC participants also demonstrated significantly greater practice effects than those with MCI. ROC curve analyses indicated that a cutoff score of <24 for the first administration (AUC = 0.82) and < 27 for the second administration (AUC = 0.85) of SM had slightly better classification accuracy than the Qmci (AUC = 0.77), and a second administration of the SM task within-session significantly improved overall classification accuracy. Conclusions: Findings suggest that a rapid web-based digit symbol substitution test is a valid screening measure that performs as well as a traditional cognitive screening test.
- Open Access
- 1 July 2025
- Published by Wiley in Alzheimer's & Dementia: Translational Research & Clinical Interventions
- Vol. 11 (3)
Development and classification accuracy of an automated cognitive screening tool combining working memory and connected speech tasks for early detection of cognitive impairment in primary care
INTRODUCTION: Cognitive screening to detect mild cognitive impairment (MCI) and dementia in primary care settings has proven to be a challenging task. The ideal solution would be a brief, yet sensitive, tool appropriate for use with individuals from diverse educational and cultural backgrounds that requires limited time and expertise from clinic staff. The purpose of this project was (1) to develop an automated cognitive screening tool incorporating cognitive and speech/language data using machine learning techniques for potential use in primary care settings and (2) to compare its classification accuracy to an established cognitive screening measure. METHODS: Participants were 53 cognitively normal and 51 cognitively impaired older adults. Each completed a working memory (WM) and four speaking tasks, followed by a second administration of WM to investigate the added utility of practice effects. Bayesian additive regression trees were used to test nine models, and the Quick Mild Cognitive Impairment screen was administered as a comparator. RESULTS: The top feature set consisted of both administrations of the WM task and a personal narrative task and achieved a cross‐validated classification accuracy (area under the receiver operating characteristics curve) of 0.84, which was slightly better than the comparator. DISCUSSION: Combining WM and acoustic and linguistic variables derived from connected speaking tasks discriminated cognitively normal from cognitively impaired groups with a high degree of accuracy. Highlights: Working memory and speaking tasks were used for detection of cognitive impairment. This combination distinguished cognitively normal from impaired older adults. This automated tool may overcome barriers to cognitive screening in primary care.
- 1 July 2025
- Published by Wiley in Alzheimer's & Dementia: Translational Research & Clinical Interventions
- Vol. 11 (3)
Open AccessDevelopment and classification accuracy of an automated cognitive screening tool combining working memory and connected speech tasks for early detection of cognitive impairment in primary care
INTRODUCTION: Cognitive screening to detect mild cognitive impairment (MCI) and dementia in primary care settings has proven to be a challenging task. The ideal solution would be a brief, yet sensitive, tool appropriate for use with individuals from diverse educational and cultural backgrounds that requires limited time and expertise from clinic staff. The purpose of this project was (1) to develop an automated cognitive screening tool incorporating cognitive and speech/language data using machine learning techniques for potential use in primary care settings and (2) to compare its classification accuracy to an established cognitive screening measure. METHODS: Participants were 53 cognitively normal and 51 cognitively impaired older adults. Each completed a working memory (WM) and four speaking tasks, followed by a second administration of WM to investigate the added utility of practice effects. Bayesian additive regression trees were used to test nine models, and the Quick Mild Cognitive Impairment screen was administered as a comparator. RESULTS: The top feature set consisted of both administrations of the WM task and a personal narrative task and achieved a cross‐validated classification accuracy (area under the receiver operating characteristics curve) of 0.84, which was slightly better than the comparator. DISCUSSION: Combining WM and acoustic and linguistic variables derived from connected speaking tasks discriminated cognitively normal from cognitively impaired groups with a high degree of accuracy. Highlights: Working memory and speaking tasks were used for detection of cognitive impairment. This combination distinguished cognitively normal from impaired older adults. This automated tool may overcome barriers to cognitive screening in primary care.
- 5 December 2024
- Published by SAGE Publications in Journal of Alzheimer’s Disease
- Vol. 103 (1) , 127-132
Utilization and perceived usefulness of monitoring technology for family caregivers of people living with Alzheimer's disease and related dementias
Background: Caregivers of people living with dementia (PLWD) often experience burden based on their care recipients’ symptoms of wandering, disorientation, and agitation. Objective: To examine the utilization and perceived value of technology-based solutions for caregiving among caregivers of PLWD. Methods: In collaboration with three Texas sites, PLWD and family caregiver dyads were recruited from clinical and community sites to assess the feasibility of a caregiving technology. PLWDs were asked to wear a GPS-based wearable device, which was paired with caregivers’ smartphone application, that enabled location monitoring and was equipped with call functions. After three months, researchers called caregivers to ask about their utilization of the “system” (i.e., wearable paired with smartphone application) and the perceived value of this technology. Forty-one caregivers completed follow-up telephone interviews. Results: About 70% of caregivers reported their care recipient wore the wearable device daily, and 39.1% used the smartphone application daily. Approximately 31% of caregivers reported daily use of the tracking feature, 30.8% reported daily use of the “safe zone” feature (i.e., geo-fencing), and 17.1% reported daily use of the two-way calling feature. About 39% of caregivers were extremely satisfied with the “system,” 43.6% found it extremely easy to use, and 46.2% found it extremely useful for caregiving. On average, caregivers with higher baseline Zarit Burden Interview scores found the “system” to be more useful with their caregiving (f = 5.97, p = 0.006) and were more satisfied with the “system” (f = 3.75, p = 0.034). Conclusions: Findings suggest caregiver burden may drive the perceived usefulness of, and satisfaction with, technology-based solutions.
- 5 December 2024
- Published by SAGE Publications in Journal of Alzheimer’s Disease
- Vol. 103 (1) , 127-132
Utilization and perceived usefulness of monitoring technology for family caregivers of people living with Alzheimer's disease and related dementias
Background: Caregivers of people living with dementia (PLWD) often experience burden based on their care recipients’ symptoms of wandering, disorientation, and agitation. Objective: To examine the utilization and perceived value of technology-based solutions for caregiving among caregivers of PLWD. Methods: In collaboration with three Texas sites, PLWD and family caregiver dyads were recruited from clinical and community sites to assess the feasibility of a caregiving technology. PLWDs were asked to wear a GPS-based wearable device, which was paired with caregivers’ smartphone application, that enabled location monitoring and was equipped with call functions. After three months, researchers called caregivers to ask about their utilization of the “system” (i.e., wearable paired with smartphone application) and the perceived value of this technology. Forty-one caregivers completed follow-up telephone interviews. Results: About 70% of caregivers reported their care recipient wore the wearable device daily, and 39.1% used the smartphone application daily. Approximately 31% of caregivers reported daily use of the tracking feature, 30.8% reported daily use of the “safe zone” feature (i.e., geo-fencing), and 17.1% reported daily use of the two-way calling feature. About 39% of caregivers were extremely satisfied with the “system,” 43.6% found it extremely easy to use, and 46.2% found it extremely useful for caregiving. On average, caregivers with higher baseline Zarit Burden Interview scores found the “system” to be more useful with their caregiving (f = 5.97, p = 0.006) and were more satisfied with the “system” (f = 3.75, p = 0.034). Conclusions: Findings suggest caregiver burden may drive the perceived usefulness of, and satisfaction with, technology-based solutions.
- Open Access
- 1 December 2024
- Published by Wiley in Alzheimer's & Dementia
- Vol. 20 (S3) , e089754
Utility of three cognitive screening tests to triage referrals to a dementia specialty clinic
Background: Due to the shortage of healthcare professionals with expertise in diagnosis and treatment of Alzheimer disease and related dementias, there are long wait times to be evaluated in dementia specialty clinics and no clear guidance about how to allocate limited resources. The purpose of this study was to examine utility of cognitive screening measures administered by clinic staff to determine level of cognitive impairment to aid in decisions about which patients may benefit from full diagnostic services.Methods: Participants were 169 older adults who completed an intake interview, including a brief cognitive screening test, conducted by a neuropsychologist at a dementia specialty clinic. During the rooming process, clinic staff administered one of three cognitive screening measures, Quick Dementia Rating Scale (QDRS; n = 47), Quick Mild Cognitive Impairment (Qmci) screen (n = 70), and the BrainCheck Standard Battery (n = 52). After the intake interview, blinded to results of these cognitive screening measures, the neuropsychologist completed an initial impressions form indicating level of cognitive impairment (i.e., none, mild, possible dementia, definite dementia). A separate neuropsychologist, blinded to information from the intake interview, completed the same form based on results of each of the three cognitive screening measures and patient demographic information.Results: Based on impressions from the intake interview, 27 patients were cognitively normal (CN), 67 had mild cognitive impairment (MCI), 32 had possible dementia, and 43 had definite dementia. Agreement on level of cognitive impairment between the intake interview and cognitive screening measures was 53% for QDRS (κ = .459, p < .001), 41% for Qmci (κ = .423, p < .001), and 48% for BrainCheck (κ = .539, p < .001). Agreement improved notably for all three measures when level of cognitive impairment was limited to two groups (i.e., CN + MCI vs possible + definite dementia): 79% for QDRS (κ = .566), 77% for Qmci (κ = .537), and 83% for BrainCheck (κ = .655).Conclusions: Cognitive screening measures administered by clinic staff and interpreted by dementia experts may have utility as time‐efficient, cost‐effective clinical decision support tools for the allocation of limited dementia diagnostic resources.
- 1 December 2024
- Published by Wiley in Alzheimer's & Dementia
- Vol. 20 (S3) , e089754
Open AccessUtility of three cognitive screening tests to triage referrals to a dementia specialty clinic
Background: Due to the shortage of healthcare professionals with expertise in diagnosis and treatment of Alzheimer disease and related dementias, there are long wait times to be evaluated in dementia specialty clinics and no clear guidance about how to allocate limited resources. The purpose of this study was to examine utility of cognitive screening measures administered by clinic staff to determine level of cognitive impairment to aid in decisions about which patients may benefit from full diagnostic services.Methods: Participants were 169 older adults who completed an intake interview, including a brief cognitive screening test, conducted by a neuropsychologist at a dementia specialty clinic. During the rooming process, clinic staff administered one of three cognitive screening measures, Quick Dementia Rating Scale (QDRS; n = 47), Quick Mild Cognitive Impairment (Qmci) screen (n = 70), and the BrainCheck Standard Battery (n = 52). After the intake interview, blinded to results of these cognitive screening measures, the neuropsychologist completed an initial impressions form indicating level of cognitive impairment (i.e., none, mild, possible dementia, definite dementia). A separate neuropsychologist, blinded to information from the intake interview, completed the same form based on results of each of the three cognitive screening measures and patient demographic information.Results: Based on impressions from the intake interview, 27 patients were cognitively normal (CN), 67 had mild cognitive impairment (MCI), 32 had possible dementia, and 43 had definite dementia. Agreement on level of cognitive impairment between the intake interview and cognitive screening measures was 53% for QDRS (κ = .459, p < .001), 41% for Qmci (κ = .423, p < .001), and 48% for BrainCheck (κ = .539, p < .001). Agreement improved notably for all three measures when level of cognitive impairment was limited to two groups (i.e., CN + MCI vs possible + definite dementia): 79% for QDRS (κ = .566), 77% for Qmci (κ = .537), and 83% for BrainCheck (κ = .655).Conclusions: Cognitive screening measures administered by clinic staff and interpreted by dementia experts may have utility as time‐efficient, cost‐effective clinical decision support tools for the allocation of limited dementia diagnostic resources.
- Open Access
- 25 November 2024
- Published by Annals of Family Medicine in The Annals of Family Medicine
- Vol. 22 (6) , 543-549
Improving Early Detection of Cognitive Impairment in Older Adults in Primary Care Clinics: Recommendations From an Interdisciplinary Geriatrics Summit
As the population ages, the prevalence of cognitive impairment due to neurodegenerative diseases such as Alzheimer disease (AD) is expected to double in the United States to nearly 14 million over the next 40 years. AD and related dementias (ADRD) are a leading cause of morbidity and mortality and among the costliest to society. Although emerging biomedical interventions for ADRD focus on early stages and are currently limited to AD, care management can benefit patients with ADRD across the disease course. Moreover, some causes of cognitive impairment are modifiable, and optimal overall management may slow or prevent additional decline. Nevertheless, a sizable proportion of cases of cognitive impairment among older adults remain undiagnosed. Primary care practitioners are often the first health care professionals to encounter cognitive concerns or to be able to observe changes in function resulting from cognitive impairment; hence, they have much to contribute to population health solutions for detecting cognitive impairment among older adults. In this report, we present key points and gaps in knowledge about methods for detecting cognitive impairment in primary care clinics. These were developed via an interdisciplinary Geriatrics Summit hosted by the National Academy of Neuropsychology in 2022, attended by representatives of national organizations engaged in work to improve care of older adults. We propose a novel workflow to facilitate detecting cognitive impairment during routine primary care, focusing on opportunities provided by the annual wellness visit, a preventive visit available to Medicare beneficiaries, along with additional recommendations and opportunities for clinical practice and research.
- 25 November 2024
- Published by Annals of Family Medicine in The Annals of Family Medicine
- Vol. 22 (6) , 543-549
Open AccessImproving Early Detection of Cognitive Impairment in Older Adults in Primary Care Clinics: Recommendations From an Interdisciplinary Geriatrics Summit
As the population ages, the prevalence of cognitive impairment due to neurodegenerative diseases such as Alzheimer disease (AD) is expected to double in the United States to nearly 14 million over the next 40 years. AD and related dementias (ADRD) are a leading cause of morbidity and mortality and among the costliest to society. Although emerging biomedical interventions for ADRD focus on early stages and are currently limited to AD, care management can benefit patients with ADRD across the disease course. Moreover, some causes of cognitive impairment are modifiable, and optimal overall management may slow or prevent additional decline. Nevertheless, a sizable proportion of cases of cognitive impairment among older adults remain undiagnosed. Primary care practitioners are often the first health care professionals to encounter cognitive concerns or to be able to observe changes in function resulting from cognitive impairment; hence, they have much to contribute to population health solutions for detecting cognitive impairment among older adults. In this report, we present key points and gaps in knowledge about methods for detecting cognitive impairment in primary care clinics. These were developed via an interdisciplinary Geriatrics Summit hosted by the National Academy of Neuropsychology in 2022, attended by representatives of national organizations engaged in work to improve care of older adults. We propose a novel workflow to facilitate detecting cognitive impairment during routine primary care, focusing on opportunities provided by the annual wellness visit, a preventive visit available to Medicare beneficiaries, along with additional recommendations and opportunities for clinical practice and research.
- 25 November 2024
- Published by Wiley in International Journal of Geriatric Psychiatry
- Vol. 39 (11) , e70026
Validation of the Quick Mild Cognitive Impairment Screen in an American Sample of Patients With Mild Cognitive Impairment and Mild Dementia
Objective: Early detection of cognitive impairment is critical for patient outcomes, yet cognitive impairment is under identified in primary care settings largely due to time constraints. The Quick Mild Cognitive Impairment (Qmci) screen was developed to address the need for a short cognitive screening instrument (< 5 min) that is sensitive to early cognitive change but has not been validated in the United States (US). The objective of this study was to examine the classification accuracy of the Qmci in participants from two memory specialty (e.g., secondary outpatient) clinics in the US.Methods: Participants were 152 older adults: 87 participants were cognitively normal (CN), 48 were diagnosed with mild cognitive impairment (MCI) and 17 were diagnosed with mild dementia (DEM). Classification accuracy of the Qmci and Mini Mental State Examination (MMSE) were compared in participants with and without cognitive impairment.Results: The Qmci demonstrated higher classification accuracy in differentiating CN from cognitively impaired participants (i.e., MCI and DEM) (AUC = 0.82) than the MMSE (AUC = 0.77). The optimal cut‐off score for the Qmci was < 67, which achieved a sensitivity of 79% and specificity of 80%. The optimal MMSE cut‐off score was < 27, which achieved a sensitivity of 97% and specificity of 43%.Conclusions: The Qmci is a valid cognitive screening instrument for detecting early stages of cognitive impairment in memory clinic samples in the US. Its short administration time and increased specificity for detecting MCI make it an attractive option for use in primary care settings. Further validation of the Qmci is needed, specifically within primary care settings.
- 25 November 2024
- Published by Wiley in International Journal of Geriatric Psychiatry
- Vol. 39 (11) , e70026
Validation of the Quick Mild Cognitive Impairment Screen in an American Sample of Patients With Mild Cognitive Impairment and Mild Dementia
Objective: Early detection of cognitive impairment is critical for patient outcomes, yet cognitive impairment is under identified in primary care settings largely due to time constraints. The Quick Mild Cognitive Impairment (Qmci) screen was developed to address the need for a short cognitive screening instrument (< 5 min) that is sensitive to early cognitive change but has not been validated in the United States (US). The objective of this study was to examine the classification accuracy of the Qmci in participants from two memory specialty (e.g., secondary outpatient) clinics in the US.Methods: Participants were 152 older adults: 87 participants were cognitively normal (CN), 48 were diagnosed with mild cognitive impairment (MCI) and 17 were diagnosed with mild dementia (DEM). Classification accuracy of the Qmci and Mini Mental State Examination (MMSE) were compared in participants with and without cognitive impairment.Results: The Qmci demonstrated higher classification accuracy in differentiating CN from cognitively impaired participants (i.e., MCI and DEM) (AUC = 0.82) than the MMSE (AUC = 0.77). The optimal cut‐off score for the Qmci was < 67, which achieved a sensitivity of 79% and specificity of 80%. The optimal MMSE cut‐off score was < 27, which achieved a sensitivity of 97% and specificity of 43%.Conclusions: The Qmci is a valid cognitive screening instrument for detecting early stages of cognitive impairment in memory clinic samples in the US. Its short administration time and increased specificity for detecting MCI make it an attractive option for use in primary care settings. Further validation of the Qmci is needed, specifically within primary care settings.
- Open Access
- 20 November 2024
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 7 (1) , e58517
mHealth Apps for Dementia Caregivers: Systematic Examination of Mobile Apps
Background: Informal caregivers of persons living with dementia are increasingly using mobile health (mHealth) apps to obtain care information. mHealth apps are seen as promising tools to better support caregivers’ complex and evolving information needs. Yet, little is known about the types and quality of dementia care information that these apps provide. Is this information for caregivers individually tailored; if so, how? Objective: We aim to address the aforementioned gaps in the literature by systematically examining the types and quality of care-related information provided in publicly available apps for caregivers of persons living with dementia as well as app features used to tailor information to caregivers’ information wants and situations. Methods: In September 2023, we used a multistage process to select mobile apps for caregivers of persons living with dementia. The final sample included 35 apps. We assessed (1) types of dementia care information provided in the apps, using our 3-item Alzheimer disease and related dementias daily care strategy framework, which encompasses educational information, tangible actions, and referral information; (2) quality of apps’ care information, using the 11 indicators recommended by the National Library of Medicine; and (3) types of tailoring to provide personalization, feedback, and content matching, which are common tailoring strategies described in the literature. Results: Educational information was the most prevalent type of information provided (29/35 apps, 83%), followed by information about tangible actions (18/35, 51%) and referrals (14/35, 40%). All apps presented their objectives clearly and avoided unrealistic or emotional claims. However, few provided information to explain whether the app’s content was generated or reviewed by experts (7/35, 20%) or how its content was selected (4/35, 11%). Further, 6 of the 35 (17%) apps implemented 1 type of tailoring; of them, 4 (11%) used content matching and the other 2 (6%) used personalization. No app used 2 types of tailoring; only 2 (6%) used all 3 types (the third is feedback). Conclusions: Existing dementia care apps do not provide sufficient high-quality, tailored information for informal caregivers. Caregivers should exercise caution when they use dementia care apps for informational support. Future research should focus on designing dementia care apps that incorporate quality-assured, transparency-enhanced, evidence-based artificial intelligence–enabled mHealth solutions for caregivers.
- 20 November 2024
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 7 (1) , e58517
Open AccessmHealth Apps for Dementia Caregivers: Systematic Examination of Mobile Apps
Background: Informal caregivers of persons living with dementia are increasingly using mobile health (mHealth) apps to obtain care information. mHealth apps are seen as promising tools to better support caregivers’ complex and evolving information needs. Yet, little is known about the types and quality of dementia care information that these apps provide. Is this information for caregivers individually tailored; if so, how? Objective: We aim to address the aforementioned gaps in the literature by systematically examining the types and quality of care-related information provided in publicly available apps for caregivers of persons living with dementia as well as app features used to tailor information to caregivers’ information wants and situations. Methods: In September 2023, we used a multistage process to select mobile apps for caregivers of persons living with dementia. The final sample included 35 apps. We assessed (1) types of dementia care information provided in the apps, using our 3-item Alzheimer disease and related dementias daily care strategy framework, which encompasses educational information, tangible actions, and referral information; (2) quality of apps’ care information, using the 11 indicators recommended by the National Library of Medicine; and (3) types of tailoring to provide personalization, feedback, and content matching, which are common tailoring strategies described in the literature. Results: Educational information was the most prevalent type of information provided (29/35 apps, 83%), followed by information about tangible actions (18/35, 51%) and referrals (14/35, 40%). All apps presented their objectives clearly and avoided unrealistic or emotional claims. However, few provided information to explain whether the app’s content was generated or reviewed by experts (7/35, 20%) or how its content was selected (4/35, 11%). Further, 6 of the 35 (17%) apps implemented 1 type of tailoring; of them, 4 (11%) used content matching and the other 2 (6%) used personalization. No app used 2 types of tailoring; only 2 (6%) used all 3 types (the third is feedback). Conclusions: Existing dementia care apps do not provide sufficient high-quality, tailored information for informal caregivers. Caregivers should exercise caution when they use dementia care apps for informational support. Future research should focus on designing dementia care apps that incorporate quality-assured, transparency-enhanced, evidence-based artificial intelligence–enabled mHealth solutions for caregivers.
- Open Access
- 6 May 2024
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 7, e53019
Assessing the Quality of ChatGPT Responses to Dementia Caregivers’ Questions: Qualitative Analysis
Background: Artificial intelligence (AI) such as ChatGPT by OpenAI holds great promise to improve the quality of life of patients with dementia and their caregivers by providing high-quality responses to their questions about typical dementia behaviors. So far, however, evidence on the quality of such ChatGPT responses is limited. A few recent publications have investigated the quality of ChatGPT responses in other health conditions. Our study is the first to assess ChatGPT using real-world questions asked by dementia caregivers themselves. Objectives: This pilot study examines the potential of ChatGPT-3.5 to provide high-quality information that may enhance dementia care and patient-caregiver education. Methods: Our interprofessional team used a formal rating scale (scoring range: 0-5; the higher the score, the better the quality) to evaluate ChatGPT responses to real-world questions posed by dementia caregivers. We selected 60 posts by dementia caregivers from Reddit, a popular social media platform. These posts were verified by 3 interdisciplinary dementia clinicians as representing dementia caregivers’ desire for information in the areas of memory loss and confusion, aggression, and driving. Word count for posts in the memory loss and confusion category ranged from 71 to 531 (mean 218; median 188), aggression posts ranged from 58 to 602 words (mean 254; median 200), and driving posts ranged from 93 to 550 words (mean 272; median 276). Results: ChatGPT’s response quality scores ranged from 3 to 5. Of the 60 responses, 26 (43%) received 5 points, 21 (35%) received 4 points, and 13 (22%) received 3 points, suggesting high quality. ChatGPT obtained consistently high scores in synthesizing information to provide follow-up recommendations (n=58, 96%), with the lowest scores in the area of comprehensiveness (n=38, 63%). Conclusions: ChatGPT provided high-quality responses to complex questions posted by dementia caregivers, but it did have limitations. ChatGPT was unable to anticipate future problems that a human professional might recognize and address in a clinical encounter. At other times, ChatGPT recommended a strategy that the caregiver had already explicitly tried. This pilot study indicates the potential of AI to provide high-quality information to enhance dementia care and patient-caregiver education in tandem with information provided by licensed health care professionals. Evaluating the quality of responses is necessary to ensure that caregivers can make informed decisions. ChatGPT has the potential to transform health care practice by shaping how caregivers receive health information.
- 6 May 2024
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 7, e53019
Open AccessAssessing the Quality of ChatGPT Responses to Dementia Caregivers’ Questions: Qualitative Analysis
Background: Artificial intelligence (AI) such as ChatGPT by OpenAI holds great promise to improve the quality of life of patients with dementia and their caregivers by providing high-quality responses to their questions about typical dementia behaviors. So far, however, evidence on the quality of such ChatGPT responses is limited. A few recent publications have investigated the quality of ChatGPT responses in other health conditions. Our study is the first to assess ChatGPT using real-world questions asked by dementia caregivers themselves. Objectives: This pilot study examines the potential of ChatGPT-3.5 to provide high-quality information that may enhance dementia care and patient-caregiver education. Methods: Our interprofessional team used a formal rating scale (scoring range: 0-5; the higher the score, the better the quality) to evaluate ChatGPT responses to real-world questions posed by dementia caregivers. We selected 60 posts by dementia caregivers from Reddit, a popular social media platform. These posts were verified by 3 interdisciplinary dementia clinicians as representing dementia caregivers’ desire for information in the areas of memory loss and confusion, aggression, and driving. Word count for posts in the memory loss and confusion category ranged from 71 to 531 (mean 218; median 188), aggression posts ranged from 58 to 602 words (mean 254; median 200), and driving posts ranged from 93 to 550 words (mean 272; median 276). Results: ChatGPT’s response quality scores ranged from 3 to 5. Of the 60 responses, 26 (43%) received 5 points, 21 (35%) received 4 points, and 13 (22%) received 3 points, suggesting high quality. ChatGPT obtained consistently high scores in synthesizing information to provide follow-up recommendations (n=58, 96%), with the lowest scores in the area of comprehensiveness (n=38, 63%). Conclusions: ChatGPT provided high-quality responses to complex questions posted by dementia caregivers, but it did have limitations. ChatGPT was unable to anticipate future problems that a human professional might recognize and address in a clinical encounter. At other times, ChatGPT recommended a strategy that the caregiver had already explicitly tried. This pilot study indicates the potential of AI to provide high-quality information to enhance dementia care and patient-caregiver education in tandem with information provided by licensed health care professionals. Evaluating the quality of responses is necessary to ensure that caregivers can make informed decisions. ChatGPT has the potential to transform health care practice by shaping how caregivers receive health information.