Optimized technique for speaker changes detection in multispeaker audio recording using pyknogram and efficient distance metric
Open Access
- 20 November 2024
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 19 (11) , e0314073
Abstract
Segmentation process is very popular in Speech recognition, word count, speaker indexing and speaker diarization process. This paper describes the speaker segmentation system which detects the speaker change point in an audio recording of multi speakers with the help of feature extraction and proposed distance metric algorithms. In this new approach, pre-processing of audio stream includes noise reduction, speech compression by using discrete wavelet transform (Daubechies wavelet ‘db40’ at level 2) and framing. It is followed by two feature extraction algorithms pyknogram and nonlinear energy operator (NEO). Finally, the extracted features of each frame are used to detect speaker change point which is accomplished by applying dissimilarity measures to find the distance between two frames. To realize it, a sliding window is moved across the whole data stream to find the highest peak which corresponds to the speaker change point. The distance metrics incorporated are standard “Bayesian Information Criteria (BIC)”, “Kullback Leibler Divergence (KLD)”, “T-test” and proposed algorithm to detect the speaker boundaries. At the end, threshold value is applied and their results are evaluated with Recall, Precision and F-measure. Best result of 99.34% is shown by proposed distance metric with pyknogram as compare to BIC, KLD and T-test algorithms.Keywords
This publication has 27 references indexed in Scilit:
- Conversion of Landsat 8 multispectral data through modified private content‐based image retrieval technique for secure transmission and privacyEngineering Reports, 2020
- Virtual reality learning environment for enhancing electronics engineering laboratory experienceComputer Applications in Engineering Education, 2020
- Study of statistical methods for texture analysis and their modern evolutionsEngineering Reports, 2020
- Designing image segmentation studies: Statistical power, sample size and reference standard qualityMedical Image Analysis, 2017
- Bayesian analysis of similarity matrices for speaker diarization2014
- Eigenvoice modelling for cross likelihood ratio based speaker clustering: A Bayesian approachComputer Speech & Language, 2013
- A review on speaker diarization systems and approachesSpeech Communication, 2012
- Online speaker segmentation and clustering using cross-likelihood ratio calculation with reference criterion selectionIET Signal Processing, 2010
- Speaker segmentation and clusteringSignal Processing, 2008
- The past, present, and future of speech processingIEEE Signal Processing Magazine, 1998