Speed Up VVC Intra-Coding by Learned Models and Feature Statistics
Authors:
Open Access
- 2 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 124609-124623
Abstract
The newest video coding standard, Versatile Video Coding (VVC), adopts a QTMT, quad-tree plus multi-type tree (MTT), block partition structure and improves the compression performance by about 30%~50%, compared with the previous High-Efficiency Video Coding (HEVC) one, at the cost of higher time complexity. To make practical video communication applications feasible, we have to reduce the high time complexity resulting from an exhaustive rate-distortion optimization (RDO) search procedure.We proposed to predict Coding Unit (CU) split modes by a learned model whose input comprises neighboring line pixels and quantization parameters (QP). In addition, we set thresholds based on statistical image features and coding behaviors to eliminate unnecessary coding operations in critical coding control modules. Experiments showed that, compared with the default VVC intra-coding, the proposed method saves 46.73% of encoding time, with Bjontegaard Delta Bit Rate (BDBR) increment of 1.16%. After retraining the learned model with a specified QP, the time reduction rate can achieve 51.79%, and the BDBR slightly increases to 2.07%. The proposed speedup coding scheme effectively reduced the VVC time complexity to a large extent.Keywords
Funding Information
- Taiwan National Science and Technology Council (NSTC 112-2221-E-011-113)
This publication has 19 references indexed in Scilit:
- Low Frequency Non-Separable Transform (LFNST)2019
- Intra prediction using multiple reference lines for the versatile video coding standard2019
- An Affine-Linear Intra Prediction With Complexity Constraints2019
- An Intra Subpartition Coding Mode for VVC2019
- Low-Complexity CTU Partition Structure Decision and Fast Intra Mode Decision for Versatile Video CodingIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Multiple Reference Line Coding for Most Probable Modes in Intra Prediction2019
- Wide Angular Intra Prediction for Versatile Video Coding2019
- Fast QTBT Partition Algorithm for Intra Frame Coding through Convolutional Neural NetworkIEEE Access, 2018
- Going deeper with convolutions2015
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012