An Error-Surface-Based Fractional Motion Estimation Algorithm and Hardware Implementation for VVC
Preprint
Abstract
Versatile Video Coding (VVC) introduces more coding tools to improve compression efficiency compared to its predecessor High Efficiency Video Coding (HEVC). For inter-frame coding, Fractional Motion Estimation (FME) still has a high computational effort, which limits the real-time processing capability of the video encoder. In this context, this paper proposes an error-surface-based FME algorithm and the corresponding hardware implementation. The algorithm creates an error surface constructed by the Rate-Distortion (R-D) cost of the integer motion vector (IMV) and its neighbors. This method requires no iteration and interpolation, thus reducing the area and power consumption and increasing the throughput of the hardware. The experimental results show that the corresponding BDBR loss is only 0.47% compared to VTM 16.0 in LD-P configuration. The hardware implementation was synthesized using GF 28nm process. It can support 13 different sizes of CU varying from 128x128 to 8x8. The measured throughput can reach 4K@30fps at 400MHz, with a gate count of 192k and power consumption of 12.64 mW. And the throughput can reach 8K@30fps at 631MHz when only quadtree is searched. To the best of our knowledge, this work is the first hardware architecture for VVC FME with interpolation-free strategiesKeywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Hardware-Friendly Search Patterns for the Versatile Video Coding Fractional Motion Estimation2021
- A Low-Power Motion Estimation Architecture for HEVC Based on a New Sum of Absolute Difference ComputationIEEE Transactions on Circuits and Systems for Video Technology, 2018
- Coding- and Energy-Efficient FME Hardware Design2018
- HEVC fast FME algorithm using IME RD-costs based error surface fitting scheme2016
- A fast fractional motion estimation algorithm for high efficiency video coding2016
- Algorithm and architecture design of the motion estimation for the H.265/HEVC 4K-UHD encoderJournal of Real-Time Image Processing, 2015
- High-Throughput Power-Efficient VLSI Architecture of Fractional Motion Estimation for Ultra-HD HEVC Video EncodingIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2015
- Fast Motion Estimation With Interpolation-Free Sub-Sample AccuracyIEEE Transactions on Circuits and Systems for Video Technology, 2010
- A Quadratic Prediction Based Fractional-Pixel Motion Estimation Algorithm for H.2642006
- Rate-distortion optimization for video compressionIEEE Signal Processing Magazine, 1998