Multi-Modal Biometric Authentication: Leveraging Shared Layer Architectures for Enhanced Security
Open Access
- 27 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 28029-28041
Abstract
In this study, we introduce a novel multi-modal biometric authentication system that integrates facial, vocal, and signature data to enhance security measures. Utilizing a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), our model architecture uniquely incorporates dual shared layers alongside modality-specific enhancements for comprehensive feature extraction. The system undergoes rigorous training with a joint loss function, optimizing for accuracy across diverse biometric inputs. Feature-level fusion via Principal Component Analysis (PCA) and classification through Gradient Boosting Machines (GBM) further refine the authentication process. Our approach demonstrates significant improvements in authentication accuracy and robustness, paving the way for advanced secure identity verification solutions.Keywords
Funding Information
- Vellore Institute of Technology, Chennai, India
This publication has 21 references indexed in Scilit:
- Learning Modality-Complementary and Eliminating-Redundancy Representations with Multi-Task Learning for Multimodal Sentiment Analysis2024
- A Vision-Language Pre-training model based on Cross Attention for Multimodal Aspect-based Sentiment Analysis2024
- Enhanced Multimodal Understanding: Integrating CNN and LSTM for Advanced Image Semantic Description2023
- Multimodal Learning Analytics: An Overview of the Data Collection Methodology2023
- Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification2022
- Transformer-based Multimodal Information Fusion for Facial Expression Analysis2022
- SPACES: Explainable Multimodal AI for Active Surveillance, Diagnosis, and Management of Adverse Childhood Experiences (ACEs)2021
- Multimodal Convolutional Neural Network Model for Protective Behavior Detection based on Body Movement Data2021
- A Review on Explainability in Multimodal Deep Neural NetsIEEE Access, 2021
- Multimodal AI System for the Rapid Diagnosis and Surgical Prediction of Necrotizing EnterocolitisIEEE Access, 2021