Intelligent Face Recognition: Comprehensive Feature Extraction Methods for Holistic Face Analysis and Modalities
Open Access
Abstract
Face recognition technology utilizes unique facial features to analyze and compare individuals for identification and verification purposes. This technology is crucial for several reasons, such as improving security and authentication, effectively verifying identities, providing personalized user experiences, and automating various operations, including attendance monitoring, access management, and law enforcement activities. In this paper, comprehensive evaluations are conducted using different face detection and modality segmentation methods, feature extraction methods, and classifiers to improve system performance. As for face detection, four methods are proposed: OpenCV’s Haar Cascade classifier, Dlib’s HOG + SVM frontal face detector, Dlib’s CNN face detector, and Mediapipe’s face detector. Additionally, two types of feature extraction techniques are proposed: hand-crafted features (traditional methods: global local features) and deep learning features. Three global features were extracted, Scale-Invariant Feature Transform (SIFT), Speeded Robust Features (SURF), and Global Image Structure (GIST). Likewise, the following local feature methods are utilized: Local Binary Pattern (LBP), Weber local descriptor (WLD), and Histogram of Oriented Gradients (HOG). On the other hand, the deep learning-based features fall into two categories: convolutional neural networks (CNNs), including VGG16, VGG19, and VGG-Face, and Siamese neural networks (SNNs), which generate face embeddings. For classification, three methods are employed: Support Vector Machine (SVM), a one-class SVM variant, and Multilayer Perceptron (MLP). The system is evaluated on three datasets: in-house, Labelled Faces in the Wild (LFW), and the Pins dataset (sourced from Pinterest) providing comprehensive benchmark comparisons for facial recognition research. The best performance accuracy for the proposed ten-feature extraction methods applied to the in-house database in the context of the facial recognition task achieved 99.8% accuracy by using the VGG16 model combined with the SVM classifier.Keywords
This publication has 76 references indexed in Scilit:
- 3D face recognition: A comprehensive survey in 2022Computational Visual Media, 2023
- Single sample face recognition using deep learning: a surveyArtificial Intelligence Review, 2023
- MTCNN++: A CNN-based face detection algorithm inspired by MTCNNThe Visual Computer, 2023
- A novel facial emotion recognition model using segmentation VGG-19 architectureInternational Journal of Information Technology, 2023
- Triangle and orthogonal local binary pattern for face recognitionMultimedia Tools and Applications, 2023
- Online attendance system based on facial recognition with face mask detectionMultimedia Tools and Applications, 2023
- Evaluation of histogram equalization and contrast limited adaptive histogram equalization effect on image quality and fractal dimensions of digital periapical radiographsOral Radiology, 2022
- Deep learning based single sample face recognition: a surveyArtificial Intelligence Review, 2022
- VGG16-random fourier hybrid model for masked face recognitionSoft Computing, 2022
- A new SURF-based algorithm for robust registration of multimodal images dataThe Visual Computer, 2022