Fine-Grained Image Quality Caption With Hierarchical Semantics Degradation
- 5 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 31 (10577149) , 3578-3590
Abstract
Blind image quality assessment (BIQA), which is capable of precisely and automatically estimating human perceived image quality with no pristine image for comparison, attracts extensive attention and is of wide applications. Recently, many existing BIQA methods commonly represent image quality with a quantitative value, which is inconsistent with human cognition. Generally, human beings are good at perceiving image quality in terms of semantic description rather than quantitative value. Moreover, cognition is a needs-oriented task where humans are able to extract image contents with local to global semantics as they need. The mediocre quality value represents coarse or holistic image quality and fails to reflect degradation on hierarchical semantics. In this paper, to comply with human cognition, a novel quality caption model is inventively proposed to measure fine-grained image quality with hierarchical semantics degradation. Research on human visual system indicates there are hierarchy and reverse hierarchy correlations between hierarchical semantics. Meanwhile, empirical evidence shows that there are also bi-directional degradation dependencies between them. Thus, a novel bi-directional relationship-based network (BDRNet) is proposed for semantics degradation description, through adaptively exploring those correlations and degradation dependencies in a bi-directional manner. Extensive experiments demonstrate that our method outperforms the state-of-the-arts in terms of both evaluation performance and generalization ability.Keywords
Funding Information
- National Natural Science Foundation of China (62022063)
- National Key Research and Development Program of China (2018AAA0101400)
This publication has 48 references indexed in Scilit:
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Using Free Energy Principle For Blind Image Quality AssessmentIEEE Transactions on Multimedia, 2014
- No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene StatisticsIEEE Signal Processing Letters, 2014
- Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian FeaturesIEEE Transactions on Image Processing, 2014
- Comparison of Four Subjective Methods for Image Quality AssessmentComputer Graphics Forum, 2012
- From Perception to Conception: How Meaningful Objects Are Processed over TimeCerebral Cortex, 2012
- Most apparent distortion: full-reference image quality assessment and the role of strategyJournal of Electronic Imaging, 2010
- View from the TopNeuron, 2002
- A Discrete Probabilistic Memory Model for Discovering Dependencies in TimeLecture Notes in Computer Science, 2001
- Long Short-Term MemoryNeural Computation, 1997