Multimodal Assessment of Schizophrenia and Depression Utilizing Video, Acoustic, Locomotor, Electroencephalographic, and Heart Rate Technology: Protocol for an Observational Study
Open Access
- 13 July 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11 (7) , e36417
Abstract
Background: Current standards of psychiatric assessment and diagnostic evaluation rely primarily on the clinical subjective interpretation of a patient’s outward manifestations of their internal state. While psychometric tools can help to evaluate these behaviors more systematically, the tools still rely on the clinician’s interpretation of what are frequently nuanced speech and behavior patterns. With advances in computing power, increased availability of clinical data, and improving resolution of recording and sensor hardware (including acoustic, video, accelerometer, infrared, and other modalities), researchers have begun to demonstrate the feasibility of cutting-edge technologies in aiding the assessment of psychiatric disorders. Objective: We present a research protocol that utilizes facial expression, eye gaze, voice and speech, locomotor, heart rate, and electroencephalography monitoring to assess schizophrenia symptoms and to distinguish patients with schizophrenia from those with other psychiatric disorders and control subjects. Methods: We plan to recruit three outpatient groups: (1) 50 patients with schizophrenia, (2) 50 patients with unipolar major depressive disorder, and (3) 50 individuals with no psychiatric history. Using an internally developed semistructured interview, psychometrically validated clinical outcome measures, and a multimodal sensing system utilizing video, acoustic, actigraphic, heart rate, and electroencephalographic sensors, we aim to evaluate the system’s capacity in classifying subjects (schizophrenia, depression, or control), to evaluate the system’s sensitivity to within-group symptom severity, and to determine if such a system can further classify variations in disorder subtypes. Results: Data collection began in July 2020 and is expected to continue through December 2022. Conclusions: If successful, this study will help advance current progress in developing state-of-the-art technology to aid clinical psychiatric assessment and treatment. If our findings suggest that these technologies are capable of resolving diagnoses and symptoms to the level of current psychometric testing and clinician judgment, we would be among the first to develop a system that can eventually be used by clinicians to more objectively diagnose and assess schizophrenia and depression with the possibility of less risk of bias. Such a tool has the potential to improve accessibility to care; to aid clinicians in objectively evaluating diagnoses, severity of symptoms, and treatment efficacy through time; and to reduce treatment-related morbidity. International Registered Report Identifier (IRRID): DERR1-10.2196/36417Keywords
All Related Versions
This publication has 76 references indexed in Scilit:
- Longitudinal studies of cognition in schizophrenia: Meta-analysisThe British Journal of Psychiatry, 2008
- Schizophrenia: Impact on quality of lifeIndian Journal of Psychiatry, 2008
- A Brief Measure for Assessing Generalized Anxiety DisorderArchives of internal medicine (1960), 2006
- Recurrent neural networks employing Lyapunov exponents for EEG signals classificationExpert Systems with Applications, 2005
- Risk taking during decision-making in normal volunteers changes with ageJournal of the International Neuropsychological Society, 2004
- The PHQ-9Journal of General Internal Medicine, 2001
- Delayed Detection of Psychosis: Causes, Consequences, and Effect on Public HealthAmerican Journal of Psychiatry, 2000
- Methods to Improve Diagnostic Accuracy in a Community Mental Health SettingAmerican Journal of Psychiatry, 2000
- Dissociable Deficits in the Decision-Making Cognition of Chronic Amphetamine Abusers, Opiate Abusers, Patients with Focal Damage to Prefrontal Cortex, and Tryptophan-Depleted Normal Volunteers Evidence for Monoaminergic MechanismsNeuropsychopharmacology, 1999
- Measuring facial movementJournal of Nonverbal Behavior, 1976