A Fast VVC Intra Prediction Based on Gradient Analysis and Multi-Feature Fusion CNN
Open Access
- 23 April 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (9) , 1963
Abstract
The Joint Video Exploration Team (JVET) has created the Versatile Video Coding Standard (VVC/H.266), the most up-to-date video coding standard, offering a broad selection of coding tools. The maturity of commercial VVC codecs can significantly reduce costs and improve coding efficiency. However, the latest video coding standards have introduced binomial and trinomial tree partitioning methods, which cause the coding units (CUs) to have various shapes, increasing the complexity of coding. This article proposes a technique to simplify VVC intra prediction through the use of gradient analysis and a multi-feature fusion CNN. The gradient of CUs is computed by employing the Sobel operator, the calculation results are used for predecision-making. Further decisions can be made by CNN for coding units that cannot be judged whether they should be segmented or not. We calculate the standard deviation (SD) and the initial depth as the input features of the CNN. To implement this method, the initial depth can be determined by constructing a segmented depth prediction dictionary. For the initial segmentation depth of the coding unit, regardless of its shape, it can also be determined by consulting the dictionary. The algorithm can determine whether to split CUs of varying sizes, decreasing the complexity of the CU division process and making VVC more practical. Experimental results demonstrate that the proposed algorithm can reduce encoding time by 36.56% with a minimal increase of 1.06% Bjøntegaard delta bit rate (BD-BR) compared to the original algorithm.Keywords
Funding Information
- National Natural Science Foundation of China (61771432, 61302118, 61702464, 21zx003, 20A880004, 222102210156, YJS2021KC12, YJS2022AL034)
- Basic Research Projects of Education Department of Henan (61771432, 61302118, 61702464, 21zx003, 20A880004, 222102210156, YJS2021KC12, YJS2022AL034)
- Key Research and Development Program of Henan (61771432, 61302118, 61702464, 21zx003, 20A880004, 222102210156, YJS2021KC12, YJS2022AL034)
- Postgraduate Education Reform and Quality Improvement Project of Henan Province (61771432, 61302118, 61702464, 21zx003, 20A880004, 222102210156, YJS2021KC12, YJS2022AL034)
This publication has 29 references indexed in Scilit:
- Adaptive CU Mode Selection in HEVC Intra Prediction: A Deep Learning ApproachCircuits, Systems, and Signal Processing, 2019
- Texture-Classification Accelerated CNN Scheme for Fast Intra CU Partition in HEVC2019
- CNN Based CU Partition Mode Decision Algorithm for HEVC Inter Coding2018
- Edge detection algorithm of image fusion based on improved Sobel operator2017
- Effective CU Size Decision for HEVC IntracodingIEEE Transactions on Image Processing, 2014
- An adaptive complexity reduction scheme with fast prediction unit decision for HEVC intra encoding2013
- Gradient-based fast decision for intra prediction in HEVC2012
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Gradient based fast mode decision algorithm for intra prediction in HEVC2012
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003