Face and Facial Expressions Recognition System for Blind People Using ResNet50 Architecture and CNN
Authors:
Open Access
- 13 September 2023
- journal article
- research article
- Published by Multimedia University in Journal of Informatics and Web Engineering
- Vol. 2 (2) , 284-298
Abstract
Many blind individuals have difficulties in recognizing people’s facial expression which may impact their social interaction. With the recognition, the blind individuals can accurately interpret and respond to the emotions. There is a lack in the existing application with the combination of face and facial expressions recognition. The blind individuals have to rely on multiple applications to accomplish the same task, making it difficult and time-consuming for them to use. The paper aims to recognize faces and facial expressions for blind individuals and provides feedback in real-time. Three face detection algorithms of Haar Cascade Classifier, Dlib, and RetinaFace are compared. Dlib is chosen to process with Histogram of Oriented Gradients (HOG) and Support Vector Machine (SVM). It loads the pre-trained model, computes the HOG features, slide the window scanning at different scales, classify the windows using the SVM classifier, generate bounding boxes, and applying non-maximum suppression. ResNet50 architecture is employed to recognize face and Convolutional Neural Networks (CNN) is applied to recognize facial expression. The training accuracy is 70% and validation accuracy is 60%.Keywords
This publication has 19 references indexed in Scilit:
- Thermal and Visual Face Recognition using Eigenfaces and Transfer Learning2022
- Real time automatic face recognition system using LBPH technique2021
- Facial Expression Recognition Using Machine Learning Techniques2021
- Facial Expression Recognition for the Blind Using Deep Learning2021
- Developing a LBPH-based Face Recognition System for Visually Impaired People2021
- Face Recognition Using Eigenface Algorithm on Laptop Camera2020
- Face Recognition System Based on CNN2020
- Reseach and Implementation of Face Detection, Tracking and Recognition Based on Video2020
- A Facial Expression Recognition Based on Improved Convolutional Neural Network2019
- High Performance Facial Expression Recognition System Using Facial Region Segmentation, Fusion of HOG & LBP Features and Multiclass SVM2018