Efficiency analysis of multihypothesis motion-compensated prediction for video coding
Author:
- 1 February 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 9 (2) , 173-183
Abstract
Overlapped block motion compensation or B-frames are examples of multihypothesis motion compensation where several motion-compensated signals are superimposed to reduce the bit-rate of a video codec. This paper extends the wide-sense stationary theory of motion-compensated prediction (MCP) for hybrid video codecs to multihypothesis motion compensation. The power spectrum of the prediction error is related to the displacement error probability density functions (pdfs) of an arbitrary number of hypotheses in a closed-form expression. We then study the influence of motion compensation accuracy on the efficiency of multihypothesis motion compensation as well as the influence of the residual noise level and the gain from optimal combination of N hypotheses. For the noise-free limiting case, doubling the number of (equally good) hypotheses can yield a gain of up to 1/2 bits/sample, while doubling the accuracy of motion compensation can additionally reduce the bit-rate by up to 1 bit/sample independent of N. For realistic noise levels, it is shown that the introduction of B-frames or overlapped block motion compensation can provide larger gains than doubling motion compensation accuracy. Spatial filtering of the motion-compensated candidate signals becomes less important if more hypotheses are combined. The critical accuracy beyond which the gain due to more accurate motion compensation is small moves to larger displacement error variances with increasing noise and increasing number of hypotheses N. Hence, sub-pel accurate motion compensation becomes less important with multihypothesis MCP. The theoretical insights are confirmed by experimental results for overlapped block motion compensation, B-frames, and multiframe motion-compensated prediction with up to eight hypotheses from ten previous frames.Keywords
This publication has 24 references indexed in Scilit:
- Rate-distortion optimized motion compensation for video compression using fixed or variable size blocks2002
- Statistical properties of prediction error images in motion compensated interlaced image coding2002
- A locally optimal design algorithm for block-based multi-hypothesis motion-compensated prediction1998
- Efficiency of displacement estimation techniquesSignal Processing: Image Communication, 1997
- Optimal block size for block-based motion-compensated video coders1997
- Optimal motion vector accuracy for block-based motion-compensated video coders1996
- Reducing rate/complexity in video coding by motion estimation with block adaptive accuracy1996
- Digitale Bildcodierung1995
- Image and Video Compression Standards1995
- Motion Compensation: Visual Aspects, Accuracy, and Fundamental Limits1993