Real-time facial emotion recognition system among children with autism based on deep learning and IoT
Top Cited Papers
Open Access
- 7 March 2023
- journal article
- research article
- Published by Springer Nature in Neural Computing and Applications
- Vol. 35 (17) , 12717-12728
Abstract
Diagnosis of autism considers a challenging task for medical experts since the medical diagnosis mainly depends on the abnormalities in the brain functions that may not appear in the early stages of early onset of autism disorder. Facial expression can be an alternative and efficient solution for the early diagnosis of Autism. This is due to Autistic children usually having distinctive patterns which facilitate distinguishing them from normal children. Assistive technology has proven to be one of the most important innovations in helping people with autism improve their quality of life. A real-time emotion identification system for autistic youngsters was developed in this study. Face identification, facial feature extraction, and feature categorization are the three stages of emotion recognition. A total of six facial emotions are detected by the propound system: anger, fear, joy, natural, sadness, and surprise. This section proposes an enhanced deep learning (EDL) technique to classify the emotions using convolutional neural network. The proposed emotion detection framework takes the benefit from using fog and IoT to reduce the latency for real-time detection with fast response and to be a location awareness. From the results, EDL outperforms other techniques as it achieved 99.99% accuracy. EDL used GA to select the optimal hyperparameters for the CNN.Keywords
Funding Information
- Kafr El Shiekh University
This publication has 29 references indexed in Scilit:
- Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environmentExpert Systems with Applications, 2013
- A Review of Technology-Based Interventions to Teach Academic Skills to Students with Autism Spectrum DisorderJournal of Autism and Developmental Disorders, 2013
- Can emotion recognition be taught to children with autism spectrum conditions?Philosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Autism and Technology: an approach to new technology-based therapeutic toolsIFMBE Proceedings, 2009
- The Experience of EmotionAnnual Review of Psychology, 2007
- The emotional hearing aid: an assistive tool for children with Asperger syndromeUniversal Access in the Information Society, 2005
- Towards interactive robots in autism therapy2004
- Face recognitionACM Computing Surveys, 2003
- Toward Functional Augmentative and Alternative Communication for Students With AutismLanguage, Speech, and Hearing Services in Schools, 2003
- Automatic analysis of facial expressions: the state of the artIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000