CTU Depth Decision Algorithms for HEVC: A Survey
Authors:
Preprint
Abstract
High-Efficiency Video Coding (HEVC) surpasses its predecessors in encoding efficiency by introducing new coding tools at the cost of an increased encoding time-complexity. The Coding Tree Unit (CTU) is the main building block used in HEVC. In the HEVC standard, frames are divided into CTUs with the predetermined size of up to 64x64 pixels. Each CTU is then divided recursively into a number of equally sized square areas, known as Coding Units (CUs). Although this diversity of frame partitioning increases encoding efficiency, it also causes an increase in the time complexity due to the increased number of ways to find the optimal partitioning. To address this complexity, numerous algorithms have been proposed to eliminate unnecessary searches during partitioning CTUs by exploiting the correlation in the video. In this paper, existing CTU depth decision algorithms for HEVC are surveyed. These algorithms are categorized into two groups, namely statistics and machine learning approaches. Statistics approaches are further subdivided into neighboring and inherent approaches. Neighboring approaches exploit the similarity between adjacent CTUs to limit the depth range of the current CTU, while inherent approaches use only the available information within the current CTU. Machine learning approaches try to extract and exploit similarities implicitly. Traditional methods like support vector machines or random forests use manually selected features, while recently proposed deep learning methods extract features during training. Finally, this paper discusses extending these methods to more recent video coding formats such as Versatile Video Coding (VVC) and AOMedia Video 1(AV1).Keywords
All Related Versions
This publication has 119 references indexed in Scilit:
- Fast CU partition-based machine learning approach for reducing HEVC complexityJournal of Real-Time Image Processing, 2019
- Adaptive CU Mode Selection in HEVC Intra Prediction: A Deep Learning ApproachCircuits, Systems, and Signal Processing, 2019
- Fast video encoding based on random forestsJournal of Real-Time Image Processing, 2019
- Fast Bayesian decision based block partitioning algorithm for HEVCMultimedia Tools and Applications, 2018
- Fast CU size decision and PU mode decision algorithm for quality SHVC inter codingMultimedia Tools and Applications, 2018
- Adaptive Early Termination Algorithm Using Coding Unit Depth History in HEVCJournal of Signal Processing Systems, 2018
- Fast inter-prediction algorithms for spatial Scalable High efficiency Video Coding SHVCSignal, Image and Video Processing, 2018
- A novel adaptive fast partition algorithm based on CU complexity analysis in HEVCMultimedia Tools and Applications, 2018
- Fast CU size and prediction mode decision algorithm for HEVC based on direction varianceJournal of Real-Time Image Processing, 2017
- Fast CU size decision and mode decision algorithm for intra prediction in HEVCMultimedia Tools and Applications, 2016