Collection and Analysis of Repeated Speech Samples: Methodological Framework and Example Protocol
Authors:
- Nicholas CumminsNCNicholas Cummins
- Lauren Louise WhiteLWLauren Louise White
- Zahia RahmanZRZahia Rahman
- Catriona LucasCLCatriona Lucas
- Tian PanTPTian Pan
- Ewan CarrECEwan Carr
- Faith MatchamFMFaith Matcham
- Johnny DownsJDJohnny Downs
- Richard DobsonRDRichard Dobson
- Thomas F QuatieriTQThomas F Quatieri
- Judith DineleyJDJudith Dineley
Open Access
- 22 July 2025
- journal article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14 (1) , e69431
Abstract
Background: Speech and language biomarkers have the potential to provide regular, objective assessments of symptom severity in several neurological and mental health conditions, both in the clinic and remotely. However, speech and language characteristics within an individual are influenced by multiple variables that can make findings highly dependent on the chosen methodology and study cohort. These characteristics are often not reported adequately in studies investigating speech-based health assessment, which (1) hinders the progress of methodological speech research, (2) prevents replication, and (3) makes the definitive identification of robust biomarkers problematic. Objective: This study aims (1) to facilitate replicable speech research by presenting a transparent speech collection and feature extraction protocol and design checklist for other researchers to adapt and design for their own experiments and (2) to demonstrate in a pilot study the feasibility of implementing our example in-laboratory protocol that reduces multiple potential confounding factors in repeated recordings of healthy speech. Methods: We developed a collection and feature extraction protocol based on a thematic literature review to enable a controlled investigation of within-individual speech variability in healthy individuals. Our protocol comprises the elicitation of read speech, held vowels, and a picture description and extraction of 14 example features relevant to health. We collected speech using a freestanding condenser microphone, 3 smartphones, and a headset to enable a sensitivity analysis across different recording devices. Results: We collected healthy speech data from 28 individuals 3 times in 1 day (the “day” cohort), with the same schedule repeated 8 to 11 weeks later, and from 25 individuals on 3 days within 1 week at fixed times (the “week” cohort). Participant characteristics collected included sex, age, native language, and voice use habits. Before each recording, we collected information on recent voice use, food and drink intake, and emotional state. Recording times were also documented. Analysis relating to exploring within-individual variability within the day and week cohorts, as well as the device-type sensitivity analysis, is ongoing, with findings expected later in 2025. Conclusions: The wide variability in speech data collection, processing, analysis, and reporting in research on speech’s use in clinical trials and practice is the motivation for this paper and the development of the speech curation protocol design checklist. Increased, more consistent reporting and justification of study protocols is urgently required to facilitate speech research replication and translation into clinical practice. International Registered Report Identifier (IRRID): DERR1-10.2196/69431Keywords
All Related Versions
This publication has 86 references indexed in Scilit:
- Current Practices in Voice Data Collection and Limitations to Voice AI Research: A National SurveyThe Laryngoscope, 2023
- Multilingual markers of depression in remotely collected speech samples: A preliminary analysisJournal of Affective Disorders, 2023
- Test-retest reliability of acoustic and linguistic measures of speech tasksComputer Speech & Language, 2023
- Advances in Parkinson's Disease detection and assessment using voice and speech: A review of the articulatory and phonatory aspectsBiomedical Signal Processing and Control, 2021
- Using Language Processing and Speech Analysis for the Identification of Psychosis and Other DisordersBiological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2020
- Automated assessment of psychiatric disorders using speech: A systematic reviewLaryngoscope Investigative Otolaryngology, 2020
- Medium-term speaker states—A review on intoxication, sleepiness and the first challengeComputer Speech & Language, 2014
- Vocal Acoustic Biomarkers of Depression Severity and Treatment ResponseBiological Psychiatry, 2012
- Aspects of speech rate and regularity in Parkinson's diseaseJournal of the Neurological Sciences, 2011
- Practice effects and the use of alternate forms in serial neuropsychological testingArchives of Clinical Neuropsychology, 2005