Toward the Achievable Rate-Distortion Bound of VVC Intra Coding: A Beam Search-Based Joint Optimization Scheme
- 1 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 32 (10577149) , 6020-6031
Abstract
In this paper, we present the first attempt at determining where the achievable rate-distortion (R-D) performance bound in versatile video coding (VVC) intra coding is when considering the mutual dependency in the rate-distortion optimization (RDO) process. In particular, the abundant search space of encoding parameters in VVC intra coding is practically explored with a beam search-based joint rate-distortion optimization (BSJRDO) scheme. As such, the partitioning, prediction and transform decisions are jointly optimized across different coding units (CUs) with a customized search subset instead of the full space. To make the beam search process implementation-friendly for VVC, the dependencies among the CUs are truncated at different depths. To facilitate finer computational scalability, the beam size is flexibly adjusted based on the characteristics of the CUs, such that the operational points that satisfy different complexity demands for diverse applications can be practically obtained. The proposed BSJRDO approach, which fully conforms to the VVC decoding syntax, can serve as both the way toward the optimal RDO bound and a practical performance-boosting solution. BSJRDO is further implemented on a VVC coding platform (VVC Test model (VTM) 12.0), and extensive experiments show that BSJRDO can achieve 1.30% and 3.22% bit rate savings compared to the VTM anchor under the common test condition and low-bit-rate coding scenarios, respectively. Moreover, the performance gain can also be flexibly customized with different computational overheads.Keywords
Funding Information
- Natural Science Foundation of China (62031013)
- Ministry of Education, Singapore, under its Tier-1 Fund (MOE2021, RG14/21)
This publication has 38 references indexed in Scilit:
- Rate‐Distortion Theory2003
- Motion-vector optimization of control grid interpolation and overlapped block motion compensation using iterated dynamic programmingIEEE Transactions on Image Processing, 2000
- Rate-distortion optimization for video compressionIEEE Signal Processing Magazine, 1998
- Rate-distortion methods for image and video compressionIEEE Signal Processing Magazine, 1998
- Rate-distortion optimal motion estimation algorithms for motion-compensated transform video codingIEEE Transactions on Circuits and Systems for Video Technology, 1998
- A video compression scheme with optimal bit allocation among segmentation, motion, and residual errorIEEE Transactions on Image Processing, 1997
- MPEG coding performance improvement by jointly optimizing coding mode decisions and rate controlIEEE Transactions on Circuits and Systems for Video Technology, 1997
- Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standardIEEE Transactions on Circuits and Systems for Video Technology, 1996
- List Viterbi decoding algorithms with applicationsIEEE Transactions on Communications, 1994
- Dynamic ProgrammingScience, 1966