Pronunciation Deviation Analysis Through Voice Cloning and Acoustic Comparison
Preprint
Abstract
This paper presents a novel approach for detecting mispronunciations by analyzing deviations between a user's original speech and their voice-cloned counterpart with corrected pronunciation. We hypothesize that regions with maximal acoustic deviation between the original and cloned utterances indicate potential mispronunciations. Our method leverages recent advances in voice cloning to generate a synthetic version of the user's voice with proper pronunciation, then performs frame-by-frame comparisons to identify problematic segments. Experimental results demonstrate the effectiveness of this approach in pinpointing specific pronunciation errors without requiring predefined phonetic rules or extensive training data for each target language.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- Computer-assisted pronunciation training: A systematic reviewReCALL, 2024
- Improving Mispronunciation Detection Using Speech ReconstructionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- Computer-assisted pronunciation training—Speech synthesis is almost all you needSpeech Communication, 2022
- Density Estimation for Statistics and Data AnalysisTechnometrics, 1987