Video Compression Artifact Reduction via Spatio-Temporal Multi-Hypothesis Prediction
Authors:
- 1 October 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 24 (12) , 6048-6061
Abstract
Annoying compression artifacts exist in most of lossy coded videos at low bit rates, which are caused by coarse quantization of transform coefficients or motion compensation from distorted frames. In this paper, we propose a compression artifact reduction approach that utilizes both the spatial and the temporal correlation to form multi-hypothesis predictions from spatio-temporal similar blocks. For each transform block, three predictions with their reliabilities are estimated, respectively. The first prediction is constructed by inversely quantizing transform coefficients directly, and its reliability is determined by the variance of quantization noise. The second prediction is derived by representing each transform block with a temporal auto-regressive (TAR) model along its motion trajectory, and its corresponding reliability is estimated from local prediction errors of the TAR model. The last prediction infers the original coefficients from similar blocks in non-local regions, and its reliability is estimated based on the distribution of coefficients in these similar blocks. Finally, all the predictions are adaptively fused according to their reliabilities to restore high-quality videos. The experimental results show that the proposed method can efficiently reduce most of the compression artifacts and improve both subjective and objective quality of block transform coded videos.Keywords
Funding Information
- National Natural Science Foundation of China (61370114, 61322106)
- National Basic Research Program of China (973 Program) (2015CB351800)
- Beijing Natural Science Foundation (4132039)
- National Research Foundation, Singapore, under its Interactive Digital Media (IDM) Strategic Research Programme
This publication has 30 references indexed in Scilit:
- HEVC Deblocking FilterIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Efficient quadtree based block-shift filtering for deblocking and deringingJournal of Visual Communication and Image Representation, 2009
- Efficient Deblocking With Coefficient Regularization, Shape-Adaptive Filtering, and Quantization ConstraintIEEE Transactions on Multimedia, 2008
- Efficient Image Deblocking Based on Postfiltering in Shifted WindowsIEEE Transactions on Circuits and Systems for Video Technology, 2008
- Postprocessing of Low Bit-Rate Block DCT Coded Images Based on a Fields of Experts PriorIEEE Transactions on Image Processing, 2007
- Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color ImagesIEEE Transactions on Image Processing, 2007
- Kernel Regression for Image Processing and ReconstructionIEEE Transactions on Image Processing, 2007
- Image Denoising Via Sparse and Redundant Representations Over Learned DictionariesIEEE Transactions on Image Processing, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- An efficient wavelet-based deblocking algorithm for highly compressed imagesIEEE Transactions on Circuits and Systems for Video Technology, 2001