Speech Emotion Detection using IoT based Deep Learning for Health Care
Authors:
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4191-4196
Abstract
Human emotions are essential to recognize the behavior and state of mind of a person. Emotion detection through speech signals has started to receive more attention lately. This paper proposes the method for detecting human emotions using speech signals and its implementation in real-time using the Internet of Things (IoT) based deep learning for the care of older adults in nursing homes. The research has two main contributions. First, we have implemented a real-time system based on audio IoT, where we have recorded human voice and predicted emotions via deep learning. Secondly, for advance classification, we have designed a model using data normalization and data augmentation techniques. Finally, we have created an integrated deep learning model, called Speech Emotion Detection (SED), using a 2D convolutional neural networks (CNN). The best accuracy that was reported by our method was approximately 95%, which outperformed all state-of-the-art approaches. We have further extended to apply the SED model to a live audio sentiment analysis system with IoT technologies for the care of older adults in nursing homes.Keywords
This publication has 17 references indexed in Scilit:
- The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American EnglishPLOS ONE, 2018
- Implementation of wavelet packet transform and non linear analysis for emotion classification in stroke patient using brain signalsBiomedical Signal Processing and Control, 2017
- Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound ClassificationIEEE Signal Processing Letters, 2017
- Improving speech recognition using data augmentation and acoustic model fusionProcedia Computer Science, 2017
- Speech emotion recognition using convolutional and Recurrent Neural Networks2016
- Exploiting IoT technologies for enhancing Health Smart Homes through patient identification and emotion recognitionComputer Communications, 2016
- Software Architecture for Smart Emotion Recognition and Regulation of the Ageing AdultCognitive Computation, 2016
- Convolutional Neural Networks for Speech RecognitionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Speaker-independent emotion recognition exploiting a psychologically-inspired binary cascade classification schemaInternational Journal of Speech Technology, 2012
- Bi-modal emotion recognition from expressive face and body gesturesJournal of Network and Computer Applications, 2007