Abstract
Facial beauty plays an important role in many fields today, such as digital entertainment, facial beautification surgery and etc. However, the facial beauty prediction task has the challenges of insufficient training datasets, low performance of traditional methods, and rarely takes advantage of the feature learning of Convolutional Neural Networks. In this paper, a transfer learning based CNN method that integrates multiple channel features is utilized for Asian female facial beauty prediction tasks. Firstly, a Large-Scale Asian Female Beauty Dataset (LSAFBD) with a more reasonable distribution has been established. Secondly, in order to improve CNN's self-learning ability of facial beauty prediction task, an effective CNN using a novel Softmax-MSE loss function and a double activation layer has been proposed. Then, a data augmentation method and transfer learning strategy were also utilized to mitigate the impact of insufficient data on proposed CNN performance. Finally, a multi-channel feature fusion method was explored to further optimize the proposed CNN model. Experimental results show that the proposed method is superior to traditional learning method combating the Asian female FBP task. Compared with other state-of-the-art CNN models, the proposed CNN model can improve the rank-1 recognition rate from 60.40% to 64.85%, and the pearson correlation coefficient from 0.8594 to 0.8829 on the LSAFBD and obtained 0.9200 regression prediction results on the SCUT dataset.
Funding Information
  • National Natural Science Foundation of China (61771347)
  • Guangdong Basic and Applied Basic Research Foundation (2019A1515010716)
  • Characteristic Innovation Project of Guangdong Province (2017KTSCX181)
  • Basic Research and Applied Basic Research Key Project in General Colleges and Universities of Guangdong Province (2018KZDXM073)
  • 2018 Opening Project of GuangDong Province Key Laboratory of Digital Signal and Image Processing (2018GDDSIPL-02)

This publication has 44 references indexed in Scilit: