Asian Female Facial Beauty Prediction Using Deep Neural Networks via Transfer Learning and Multi-Channel Feature Fusion
Open Access
- 13 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 56892-56907
Abstract
Facial beauty plays an important role in many fields today, such as digital entertainment, facial beautification surgery and etc. However, the facial beauty prediction task has the challenges of insufficient training datasets, low performance of traditional methods, and rarely takes advantage of the feature learning of Convolutional Neural Networks. In this paper, a transfer learning based CNN method that integrates multiple channel features is utilized for Asian female facial beauty prediction tasks. Firstly, a Large-Scale Asian Female Beauty Dataset (LSAFBD) with a more reasonable distribution has been established. Secondly, in order to improve CNN's self-learning ability of facial beauty prediction task, an effective CNN using a novel Softmax-MSE loss function and a double activation layer has been proposed. Then, a data augmentation method and transfer learning strategy were also utilized to mitigate the impact of insufficient data on proposed CNN performance. Finally, a multi-channel feature fusion method was explored to further optimize the proposed CNN model. Experimental results show that the proposed method is superior to traditional learning method combating the Asian female FBP task. Compared with other state-of-the-art CNN models, the proposed CNN model can improve the rank-1 recognition rate from 60.40% to 64.85%, and the pearson correlation coefficient from 0.8594 to 0.8829 on the LSAFBD and obtained 0.9200 regression prediction results on the SCUT dataset.Keywords
Funding Information
- National Natural Science Foundation of China (61771347)
- Guangdong Basic and Applied Basic Research Foundation (2019A1515010716)
- Characteristic Innovation Project of Guangdong Province (2017KTSCX181)
- Basic Research and Applied Basic Research Key Project in General Colleges and Universities of Guangdong Province (2018KZDXM073)
- 2018 Opening Project of GuangDong Province Key Laboratory of Digital Signal and Image Processing (2018GDDSIPL-02)
This publication has 44 references indexed in Scilit:
- Deep self-taught learning for facial beauty predictionNeurocomputing, 2014
- “Wow! You Are So Beautiful Today!”ACM Transactions on Multimedia Computing, Communications, and Applications, 2014
- Cost-sensitive ordinal regression for fully automatic facial beauty assessmentNeurocomputing, 2014
- The cluster assessment of facial attractiveness using fuzzy neural network classifier based on 3D Moiré featuresPattern Recognition, 2014
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Prediction of facial attractiveness from facial proportionsPattern Recognition, 2012
- Quantitative analysis of human facial beauty using geometric featuresPattern Recognition, 2011
- On the Expressive Power of Deep Architectures2011
- Facial Attractiveness: Beauty and the MachineNeural Computation, 2006
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998