Measurement of neuropsychiatric symptoms in the older adults with mild cognitive impairment based on speech and facial expressions: a cross-sectional observational study
- 16 November 2023
- journal article
- research article
- Published by Taylor & Francis in Aging & Mental Health
- Vol. 28 (5) , 828-837
Abstract
ObjectivesTo examine the association between speech and facial features with depression, anxiety, and apathy in older adults with mild cognitive impairment (MCI).MethodsSpeech and facial expressions of 319 MCI patients were digitally recorded via audio and video recording software. Three of the most common neuropsychiatric symptoms (NPS) were evaluated by the Public Health Questionnaire, General Anxiety Disorder, and Apathy Evaluation Scale, respectively. Speech and facial features were extracted using the open-source data analysis toolkits. Machine learning techniques were used to validate the diagnostic power of extracted features.ResultsDifferent speech and facial features were associated with specific NPS. Depression was associated with spectral and temporal features, anxiety and apathy with frequency, energy, spectral, and temporal features. Additionally, depression was associated with facial features (action unit, AU) 10, 12, 15, 17, 25, anxiety with AU 10, 15, 17, 25, 26, 45, and apathy with AU 5, 26, 45. Significant differences in speech and facial features were observed between males and females. Based on machine learning models, the highest accuracy for detecting depression, anxiety, and apathy reached 95.8%, 96.1%, and 83.3% for males, and 87.8%, 88.2%, and 88.6% for females, respectively.ConclusionDepression, anxiety, and apathy were characterized by distinct speech and facial features. The machine learning model developed in this study demonstrated good classification in detecting depression, anxiety, and apathy. A combination of audio and video may provide objective methods for the precise classification of these symptoms.Keywords
This publication has 29 references indexed in Scilit:
- The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective ComputingIEEE Transactions on Affective Computing, 2015
- A review of depression and suicide risk assessment using speech analysisSpeech Communication, 2015
- Hyperopt: a Python library for model selection and hyperparameter optimizationComputational Science & Discovery, 2015
- The Diagnosis and Management of Mild Cognitive ImpairmentJAMA, 2014
- Gender and Emotion Expression: A Developmental Contextual PerspectiveEmotion Review, 2014
- Mild cognitive impairment: a concept in evolutionJournal of Internal Medicine, 2014
- Changes in Acoustic Characteristics of the Voice Across the Life Span: Measures From Individuals 4–93 Years of AgeJournal of Speech, Language, and Hearing Research, 2011
- Estimation of prediction error by using K-fold cross-validationStatistics and Computing, 2009
- The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same ConstructsJournal of Marketing Research, 2007
- Apathy in late-life depression among Taiwanese patientsInternational Psychogeriatrics, 2007