An Interpolation-Free Fractional Motion Estimation Algorithm and Hardware Implementation for VVC
- 17 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 33 (2) , 395-407
Abstract
Versatile video coding (VVC) introduces multi-type tree (MTT) and larger coding tree unit (CTU) to improve compression efficiency compared to its predecessor High Efficiency Video Coding (HEVC). This leads to higher throughput for fractional motion estimation (FME) to meet the needs of real-time processing. In this context, this article proposes an interpolation-free algorithm based on an error surface to improve the throughput of FME hardware. The error surface is constructed by the rate-distortion costs (RDCs) of the integer motion vector (IMV) and its neighbors. To improve the prediction accuracy, a hardware-friendly RDC estimation strategy is proposed to construct the error surface. The experimental results show that the corresponding Bjontegaard Delta Bit Rate (BDBR) in Random Access (RA), Low Delay P (LDP) and Low Delay B (LDB) configuration increases by only 0.358%, 0.479%, and 0.511% compared with the VVC test model (VTM) 16.0. Compared with the default FME algorithms of VVC, the time cost of FME is reduced by 53.47%, 56.28%, and 54.23%, respectively, in RA, LDP, and LDB configurations. The algorithm is free of iteration and interpolation, which can contribute to low-cost and high-throughput hardware. The proposed architecture can support FME of all coding units (CUs) in a CTU with one layer of MTT under the quaternary tree (QT), and the CU size can vary from $8\times 8$ to $128\times 128$ . Synthesized using GF 28-nm process, the architecture can achieve $7680\times 4320$ @60 fps throughput at 800 MHz, with a gate count of 244 K and power consumption of 76.5 mW. This proposed architecture can meet the real-time coding requirements of VVC.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2023YFB4502802)
- National Natural Science Foundation of China (62031009)
- Alibaba Innovative Research (AIR) Program
- Alibaba Research Fellow (ARF) Program
This publication has 40 references indexed in Scilit:
- Architecture Design of AVS3 Fractional Motion Estimation for 4K UHD Video Coding2023
- Approximate Versatile Video Coding Fractional Interpolation Filters and Their Hardware ImplementationsIEEE Transactions on Consumer Electronics, 2021
- A Reconfigurable Fractional Interpolation Hardware for VVC Motion Compensation2018
- A Low-power Pyramid Motion Estimation Engine for 4K@30fps Realtime HEVC Video Encoding2018
- Coding- and Energy-Efficient FME Hardware Design2018
- Algorithm and architecture design of the motion estimation for the H.265/HEVC 4K-UHD encoderJournal of Real-Time Image Processing, 2015
- A Reconfigurable Hardware Architecture for Fractional Pixel Interpolation in High Efficiency Video CodingIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2014
- A 1.59 Gpixel/s Motion Estimation Processor With $-$211 to +211 Search Range for UHDTV Video EncoderIEEE Journal of Solid-State Circuits, 2013
- A Hardware-Efficient H.264/AVC Motion-Estimation Design for High-Definition VideoIEEE Transactions on Circuits and Systems I: Regular Papers, 2008
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003