A Semi-Supervised Lie Detection Algorithm Based on Integrating Multiple Speech Emotional Features

Authors:
Open Access
Publisher website
Google Scholar
Abstract
When people tell lies, they often exhibit tension and emotional fluctuations, reflecting a complex psychological state. However, the scarcity of labeled data in datasets and the complexity of deception information pose significant challenges in extracting effective lie features, which severely restrict the accuracy of lie detection systems. To address this, this paper proposes a semi-supervised lie detection algorithm based on integrating multiple speech emotional features. Firstly, Long Short-Term Memory (LSTM) and Auto Encoder (AE) network process log Mel spectrogram features and acoustic statistical features, respectively, to capture the contextual links between similar features. Secondly, the joint attention model is used to learn the complementary relationship among different features to obtain feature representations with richer details. Lastly, the model combines the unsupervised loss Local Maximum Mean Discrepancy (LMMD) and supervised loss Jefferys multi-loss optimization to enhance the classification performance. Experimental results show that the algorithm proposed in this paper achieves better performance.
Funding Information
  • Science and Technology Plan Project of Changzhou (CJ20210155, 23KJA520001, 22A520004, 22A510001)
  • Natural Science Foundation of the Jiangsu Higher Education Institutions of China (CJ20210155, 23KJA520001, 22A520004, 22A510001)
  • Henan Province Key Scientific Research Projects Plan of Colleges and Universities (CJ20210155, 23KJA520001, 22A520004, 22A510001)

This publication has 18 references indexed in Scilit: