Facial Beauty Prediction Combined with Multi-Task Learning of Adaptive Sharing Policy and Attentional Feature Fusion
Open Access
- 30 December 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 13 (1) , 179
Abstract
Facial beauty prediction (FBP) is a leading research subject in the field of artificial intelligence (AI), in which computers make facial beauty judgments and predictions similar to those of humans. At present, the methods are mainly based on deep neural networks. However, there still exist some problems such as insufficient label information and overfitting. Multi-task learning uses label information from multiple databases, which increases the utilization of label information and enhances the feature extraction ability of the network. Attentional feature fusion (AFF) combines semantic information and introduces an attention mechanism to reduce the risk of overfitting. In this study, the multi-task learning of an adaptive sharing policy combined with AFF is presented based on the adaptive sharing (AdaShare) network in FBP. First, an adaptive sharing policy is added to multi-task learning with ResNet18 as the backbone network. Second, the AFF is introduced at the short skip connections of the network. The proposed method improves the accuracy of FBP by solving the problems of insufficient label information and overfitting issues. The experimental results based on the large-scale Asia facial beauty database (LSAFBD) and SCUT-FBP5500 databases show that the proposed method outperforms the single-database single-task baseline and can be applied extensively in image classification and other fields.Keywords
Funding Information
- National Natural Science Foundation of China (61771347)
This publication has 21 references indexed in Scilit:
- An Adaptive Weight Learning-Based Multitask Deep Network for Continuous Blood Pressure Estimation Using Electrocardiogram SignalsSensors, 2021
- Multi-Dataset, Multitask Learning of Egocentric Vision TasksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- Task Similarity Estimation Through Adversarial Multitask Neural NetworkIEEE Transactions on Neural Networks and Learning Systems, 2020
- Designing Network Design Spaces2020
- Multi-Task Learning for Recommendation Over Heterogeneous Information NetworkIEEE Transactions on Knowledge and Data Engineering, 2020
- ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design2018
- MobileNetV2: Inverted Residuals and Linear Bottlenecks2018
- Densely Connected Convolutional Networks2017
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015