Blind Image Quality Assessment via Deep Learning

Authors:

Abstract
This paper investigates how to blindly evaluate the visual quality of an image by learning rules from linguistic descriptions. Extensive psychological evidence shows that humans prefer to conduct evaluations qualitatively rather than numerically. The qualitative evaluations are then converted into the numerical scores to fairly benchmark objective image quality assessment (IQA) metrics. Recently, lots of learning-based IQA models are proposed by analyzing the mapping from the images to numerical ratings. However, the learnt mapping can hardly be accurate enough because some information has been lost in such an irreversible conversion from the linguistic descriptions to numerical scores. In this paper, we propose a blind IQA model, which learns qualitative evaluations directly and outputs numerical scores for general utilization and fair comparison. Images are represented by natural scene statistics features. A discriminative deep model is trained to classify the features into five grades, corresponding to five explicit mental concepts, i.e., excellent, good, fair, poor, and bad. A newly designed quality pooling is then applied to convert the qualitative labels into scores. The classification framework is not only much more natural than the regression-based models, but also robust to the small sample size problem. Thorough experiments are conducted on popular databases to verify the model's effectiveness, efficiency, and robustness.
Funding Information
  • National Natural Science Foundation of China (61125204, 61125106, 61172146, 61101250, 61372130)
  • Fundamental Research Funds for the Central Universities (K5051202048, BDZ021403, JB149901)
  • Program for Changjiang Scholars and Innovative Research Team with the University of China (IRT13088)
  • Shaanxi Innovative Research Team for Key Science and Technology (2012KCT-02)
  • Key Research Program, Chinese Academy of Sciences, Beijing, China (KGZDEW-T03)
  • Australian Research Counci (FT-130101457, DP-120103730, LP-140100569)

This publication has 34 references indexed in Scilit: