High Quality Video Frames From VVC: A Deep Neural Network Approach
Open Access
- 1 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 54254-54264
Abstract
In recent years, video content has become a significant contributor to Internet traffic, prompting the development of efficient codecs, such as High Efficiency Video Coding (HEVC) and Versatile Video Coding (VVC), to reduce bandwidth usage and storage requirements. However, these video coding standards still exhibit quality degradation and artifacts in the decoded frames. To address this issue, researchers have introduced several network architectures based on deep-learning algorithms; however, most of them focus on in-loop filtering, which requires additional bits to transmit filter information from the encoder to the decoder under a video-coding framework. In this paper, we propose a neural-network-based post-processing method to enhance the decoded frames. In the experimental result, the proposed model achieves a significant bitrate reduction, as measured by Bjøntegaard Delta of 4.54%, 4.13%, and 5.21% for random access (RA), low-delay (LD), and all-intra (AI) configurations, respectively, while also improving peak signal-to-noise ratio (PSNR).Keywords
Funding Information
- National Research Foundation of Korea
- Korean Government [Ministry of Science and ICT (MSIT)] (NRF-2021R1F1A1060816)
- Gachon University Research Fund of 2021 (GCU-202110040001)
This publication has 25 references indexed in Scilit:
- Content-Aware Convolutional Neural Network for In-Loop Filtering in High Efficiency Video CodingIEEE Transactions on Image Processing, 2019
- Residual Highway Convolutional Neural Networks for in-loop Filtering in HEVCIEEE Transactions on Image Processing, 2018
- CNN based post-processing to improve HEVC2017
- Multi-modal/multi-scale convolutional neural network based in-loop filter design for next generation video codec2017
- A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding2016
- CNN-based in-loop filtering for coding efficiency improvement2016
- Compression Artifacts Reduction by a Deep Convolutional Network2015
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003