CDINet: Content Distortion Interaction Network for Blind Image Quality Assessment
- 20 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 7089-7100
Abstract
Perceptual image quality is related to content and distortion. Distortion classification is a common way to learn distortion information. How to extract distortion information consistent with human perception is a problem to be solved. Besides, the joint effect on image quality caused by the interplay of content and distortion has not been fully studied. In this paper, a novel Content Distortion Interaction Network (CDINet) is proposed for blind image quality assessment. Distortion representation are guided by content representation to learn quality-aware representation. CDINet consists of four components: a Distortion-Aware Module (DAM), a Content-Aware Module (CAM), an Asymmetric Content-Distortion Interaction (ACDI) module, and a quality regression module. The content representation and distortion representation are extracted respectively and fused interactively in CDINet. Specifically, with the assistance of image restoration, distortion representation consistent with human perception is learned. To further improve the ability in distortion representation, the DAM is used to construct the differences between the distorted image and its reference image. The proposed ACDI module enables the interaction of content and distortion representations to occur at different levels with less computational cost. Since the proposed CDINet considers the joint impact on image quality caused by the interplay of content and distortion, the predicted image qualities highly align with human perception. Comprehensive experiments on 8 benchmark datasets demonstrate that the proposed CDINet effectively extracts quality-aware representation, achieving state-of-the-art performance in evaluating both synthetically and authentically distorted images.Keywords
Funding Information
- National Natural Science Foundation of China (62371305, 62001302)
- Basic and Applied Basic Research Foundation of Guangdong Province (2021A1515011348)
- Natural Science Foundation of Shenzhen (JCYJ20230808105906013)
- Shenzhen University
This publication has 54 references indexed in Scilit:
- PIPAL: A Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration2020
- Semantic-aware blind image quality assessmentSignal Processing: Image Communication, 2018
- A new blind image quality framework based on natural color statisticNeurocomputing, 2016
- Image database TID2013: Peculiarities, results and perspectivesSignal Processing: Image Communication, 2015
- Unsupervised feature learning framework for no-reference image quality assessment2012
- On performance of image quality metrics enhanced with visual attention computational modelsElectronics Letters, 2012
- Saliency-Based Image Quality Assessment Criterion2008
- Noise Estimation from a Single Image2006
- Perceptual blur and ringing metrics: application to JPEG2000Signal Processing: Image Communication, 2004
- Neuronal correlates of visibility and invisibility in the primate visual systemNature Neuroscience, 1998