Motion Refinement Based Progressive Side-Information Estimation for Wyner-Ziv Video Coding
Authors:
- 1 November 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 20 (12) , 1863-1875
Abstract
During the past ten years, Wyner-Ziv video coding (WZVC) has gained a lot of research interests because of its unique characteristics of "simple encoding, complex de coding." However, the performance gap between WZVC and conventional video coding has never been closed to the point promised by the information theory. In this paper, we illustrate the chicken-and-egg dilemma encountered in WZVC: high efficiency WZVC requires good estimation of side information (SI); however, good SI estimation is not possible for the decoder without access to the decoded current frame. To resolve such a dilemma, we present and advocate a framework that explores an important concept of decoder-side progressive-learning. More specifically, a decoder-side multi-resolution motion refinement (MRMR) scheme is proposed, where the decoder is able to learn from the already-decoded lower-resolution data to refine the motion estimation (ME), which in turn greatly improves the SI quality as well as the coding efficiency for the higher resolution data. Theoretical analysis shows that at high rates, decoder-side MRMR outperforms motion extrapolation by as much as 5 dB, while falling behind conventional encoder-side inter-frame ME by only about 1.5 dB. In addition, since decoder-side ME does not suffer from the bit-rate overhead in transmitting the motion information, further performance gain can be achieved for decoder-side MRMR by incorporating fractional-pel motion search, block matching with smaller block sizes, and multiple hypothesis prediction. We also present a practical WZVC implementation with MRMR, which shows comparable coding performance as H.264 at very high bit rates.Keywords
This publication has 23 references indexed in Scilit:
- Motion-Based Side-Information Generation for a Scalable Wyner-Ziv Video Coder2007
- Rate-adaptive codes for distributed source codingSignal Processing, 2006
- Backward Channel Aware Wyner-Ziv Video Coding2006
- Motion compensated refinement for low complexity pixel based distributed video coding2006
- Wyner-ziv video coding with hash-based motion compensation at the receiver2005
- Iterative generation of motion-compensated side information for distributed video coding2005
- PRISM: an uplink-friendly multimedia coding paradigm2004
- Rate-distortion methods for image and video compressionIEEE Signal Processing Magazine, 1998
- Motion-compensating prediction with fractional-pel accuracyIEEE Transactions on Communications, 1993
- The Efficiency of Motion-Compensating Prediction for Hybrid Coding of Video SequencesIEEE Journal on Selected Areas in Communications, 1987