Blind Image Quality Assessment via Deep Learning
Authors:
Top Cited Papers
- 6 August 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (6) , 1275-1286
Abstract
This paper investigates how to blindly evaluate the visual quality of an image by learning rules from linguistic descriptions. Extensive psychological evidence shows that humans prefer to conduct evaluations qualitatively rather than numerically. The qualitative evaluations are then converted into the numerical scores to fairly benchmark objective image quality assessment (IQA) metrics. Recently, lots of learning-based IQA models are proposed by analyzing the mapping from the images to numerical ratings. However, the learnt mapping can hardly be accurate enough because some information has been lost in such an irreversible conversion from the linguistic descriptions to numerical scores. In this paper, we propose a blind IQA model, which learns qualitative evaluations directly and outputs numerical scores for general utilization and fair comparison. Images are represented by natural scene statistics features. A discriminative deep model is trained to classify the features into five grades, corresponding to five explicit mental concepts, i.e., excellent, good, fair, poor, and bad. A newly designed quality pooling is then applied to convert the qualitative labels into scores. The classification framework is not only much more natural than the regression-based models, but also robust to the small sample size problem. Thorough experiments are conducted on popular databases to verify the model's effectiveness, efficiency, and robustness.Keywords
Funding Information
- National Natural Science Foundation of China (61125204, 61125106, 61172146, 61101250, 61372130)
- Fundamental Research Funds for the Central Universities (K5051202048, BDZ021403, JB149901)
- Program for Changjiang Scholars and Innovative Research Team with the University of China (IRT13088)
- Shaanxi Innovative Research Team for Key Science and Technology (2012KCT-02)
- Key Research Program, Chinese Academy of Sciences, Beijing, China (KGZDEW-T03)
- Australian Research Counci (FT-130101457, DP-120103730, LP-140100569)
This publication has 34 references indexed in Scilit:
- Learning Deep and Wide: A Spectral Method for Learning Deep NetworksIEEE Transactions on Neural Networks and Learning Systems, 2014
- On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep ArchitecturesIEEE Transactions on Neural Networks and Learning Systems, 2014
- Bilinear deep learning for image classification2011
- Deep Belief Networks using discriminative features for phone recognition2011
- Blind Image Quality Assessment Using a General Regression Neural NetworkIEEE Transactions on Neural Networks, 2011
- Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]IEEE Computational Intelligence Magazine, 2010
- A unified architecture for natural language processing2008
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Image information and visual qualityIEEE Transactions on Image Processing, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004