Block Partitioning Information-Based CNN Post-Filtering for EVC Baseline Profile
Author:
Open Access
Abstract
The need for efficient video coding technology is more important than ever in the current scenario where video applications are increasing worldwide, and Internet of Things (IoT) devices are becoming widespread. In this context, it is necessary to carefully review the recently completed MPEG-5 Essential Video Coding (EVC) standard because the EVC Baseline profile is customized to meet the specific requirements needed to process IoT video data in terms of low complexity. Nevertheless, the EVC Baseline profile has a notable disadvantage. Since it is a codec composed only of simple tools developed over 20 years, it tends to represent numerous coding artifacts. In particular, the presence of blocking artifacts at the block boundary is regarded as a critical issue that must be addressed. To address this, this paper proposes a post-filter using a block partitioning information-based Convolutional Neural Network (CNN). The proposed method in the experimental results objectively shows an approximately 0.57 dB for All-Intra (AI) and 0.37 dB for Low-Delay (LD) improvements in each configuration by the proposed method when compared to the pre-post-filter video, and the enhanced PSNR results in an overall bitrate reduction of 11.62% for AI and 10.91% for LD in the Luma and Chroma components, respectively. Due to the huge improvement in the PSNR, the proposed method significantly improved the visual quality subjectively, particularly in blocking artifacts at the coding block boundary.Keywords
Funding Information
- Kyung Hee University in 2023 (KHU-20230874, RS-2023-00220204)
- Institute of Information & Communications Technology Planning & Evaluation (IITP) (KHU-20230874, RS-2023-00220204)
This publication has 21 references indexed in Scilit:
- High Quality Video Frames From VVC: A Deep Neural Network ApproachIEEE Access, 2023
- BVI-DVC: A Training Database for Deep Video CompressionIEEE Transactions on Multimedia, 2021
- One-for-All: An Efficient Variable Convolution Neural Network for In-Loop Filter of VVCIEEE Transactions on Circuits and Systems for Video Technology, 2021
- Artificial Intelligence-Based Sensors for Next Generation IoT Applications: A ReviewIEEE Sensors Journal, 2021
- Video Compression With CNN-Based PostprocessingIEEE MultiMedia, 2021
- Internet of Video Things: Next-Generation IoT With Visual SensorsIEEE Internet of Things Journal, 2020
- The Why, What, and How of Immersive ExperienceIEEE Access, 2020
- An Overview of the MPEG-5 Essential Video Coding Standard [Standards in a Nutshell]IEEE Signal Processing Magazine, 2020
- Attention-Based Dual-Scale CNN In-Loop Filter for Versatile Video CodingIEEE Access, 2019
- Residual Highway Convolutional Neural Networks for in-loop Filtering in HEVCIEEE Transactions on Image Processing, 2018