Enhancing CNN-Based Blind Image Quality Assessment via Deep Cross-Layer Pattern Encoding
- 7 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 27 (15209210) , 9712-9722
Abstract
Evaluating image quality without reference images, known as blind image quality assessment (BIQA), is crucial for image communication. Recently, convolutional neural networks (CNNs) have emerged as a prominent BIQA approach due to their feature learning power. Usually, both high-level semantic information and low-level details significantly impact perceived visual quality. However, most existing CNN-based methods focus on high-level semantic information via aggregating features on top of the last convolutional layer into a global descriptor, neglecting the importance of shallow, low-level cues. To address this limitation, this paper proposes a novel approach that exploits local encoding and histogram-based pyramid pooling on crosslayer features produced by a CNN, achieving a joint local and global analysis. Specifically, we introduce a cross-layer pattern encoding model that characterizes features generated along convolutional layers via a soft histogram of local 3D binary patterns. This leads to a highly informative yet compact descriptor for score regression. By building this module into a ResNet backbone, we present an effective BIQA model demonstrating state-ofthe-art performance in extensive experiments on synthetic and authentic datasets.Keywords
Funding Information
- National Natural Science Foundation of China (62401210)
- Natural Science Foundation of Guangdong Province (2025A1515011539)
- Basic and Applied Basic Research Foundation of Guangdong Province (2023A1515110646)
- Guangzhou Basic and Applied Basic Research Project (2025A04J4502)
- National Key Research and Development Program of China (2024YFE0105400)
- National Natural Science Foundation of China (62472179)
- Guangzhou Science and Technology Plan Project - Key R and D Plan (2024B01W0007)
- Key Research and Development Project of Guangzhou (202206010091)
- Fund of Southern Marine Science and Engineering Guangdong Laboratory at Zhanjiang (ZJW-2023-04)
- Special Fund for Marine Economic Development of Guangdong Province, China (GDNRC[2024])
This publication has 74 references indexed in Scilit:
- Boosting Image Quality Assessment Through Efficient Transformer Adaptation with Local Feature Enhancement2024
- Perceptual Quality Assessment of Smartphone Photography2020
- Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network2020
- MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment2020
- Blind image quality assessment via learnable attention-based poolingPattern Recognition, 2019
- Blind Predicting Similar Quality Map for Image Quality Assessment2018
- Image quality assessment based on multi-feature extraction and synthesis with support vector regressionSignal Processing: Image Communication, 2017
- Deep Residual Learning for Image Recognition2016
- Group MAD Competition? A New Methodology to Compare Objective Image Quality Models2016
- Image database TID2013: Peculiarities, results and perspectivesSignal Processing: Image Communication, 2015