Performance of Forced-Alignment Algorithms on Children's Speech
- 11 March 2021
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 64 (6S) , 2213-2222
Abstract
Purpose: Acoustic measurement of speech sounds requires first segmenting the speech signal into relevant units (words, phones, etc.). Manual segmentation is cumbersome and time consuming. Forced-alignment algorithms automate this process by aligning a transcript and a speech sample. We compared the phoneme-level alignment performance of five available forced-alignment algorithms on a corpus of child speech. Our goal was to document aligner performance for child speech researchers. Method: The child speech sample included 42 children between 3 and 6 years of age. The corpus was force-aligned using the Montreal Forced Aligner with and without speaker adaptive training, triphone alignment from the Kaldi speech recognition engine, the Prosodylab-Aligner, and the Penn Phonetics Lab Forced Aligner. The sample was also manually aligned to create gold-standard alignments. We evaluated alignment algorithms in terms of accuracy (whether the interval covers the midpoint of the manual alignment) and difference in phone-onset times between the automatic and manual intervals. Results: The Montreal Forced Aligner with speaker adaptive training showed the highest accuracy and smallest timing differences. Vowels were consistently the most accurately aligned class of sounds across all the aligners, and alignment accuracy increased with age for fricative sounds across the aligners too. Conclusion: The best-performing aligner fell just short of human-level reliability for forced alignment. Researchers can use forced alignment with child speech for certain classes of sounds (vowels, fricatives for older children), especially as part of a semi-automated workflow where alignments are later inspected for gross errors. Supplemental Material: https://doi.org/10.23641/asha.14167058Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Children's Consonant Acquisition in 27 Languages: A Cross-Linguistic ReviewAmerican Journal of Speech-Language Pathology, 2018
- Investigating the Role of L1 in Automatic Pronunciation Evaluation of L2 Speech2018
- Methods for eliciting, annotating, and analyzing databases for child speech developmentComputer Speech & Language, 2017
- Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi2017
- Librispeech: An ASR corpus based on public domain audio books2015
- Fitting Linear Mixed-Effects Models Usinglme42015
- The private life of stops: VOT in a real-time corpus of spontaneous GlaswegianLaboratory Phonology, 2015
- Automatic detection of “g-dropping” in American English using forced alignment2011
- Speaker identification on the SCOTUS corpusThe Journal of the Acoustical Society of America, 2008
- Hidden mode HMM using Bayesian network for modeling speaking rate fluctuation2004