Spatiotemporal Selective Extrapolation for 3-D Signals and Its Applications in Video Communications
- 13 August 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 16 (9) , 2348-2360
Abstract
In this paper, we derive a spatiotemporal extrapolation method for 3-D discrete signals. Extending a discrete signal beyond a limited number of known samples is commonly referred to as discrete signal extrapolation. Extrapolation problems arise in many applications in video communications. Transmission errors in video communications may cause data losses which are concealed by extrapolating the surrounding video signal into the missing area. The same principle is applied for TV logo removal. Prediction in hybrid video coding is also interpreted as an extrapolation problem. Conventionally, the unknown areas in the video sequence are estimated from either the spatial or temporal surrounding. Our approach considers the spatiotemporal signal including the missing area in a volume and replaces the unknown samples by extrapolating the surrounding signal from spatial, as well as temporal direction. By exploiting spatial and temporal correlations at the same time, it is possible to inherently compensate motion. Deviations in luminance occurring from frame to frame can be compensated, too.Keywords
This publication has 18 references indexed in Scilit:
- 2D Frequency Selective Extrapolation for Spatial Error Concealment in H.264/AVC Video Coding2006
- Frequency selective signal extrapolation with applications to error concealment in image communicationAEU - International Journal of Electronics and Communications, 2005
- Minimizing a weighted error criterion for spatial error concealment of missing image data2005
- Spatial error concealment of corrupted image data using frequency selective extrapolation2004
- Efficient prediction of uncovered background in interframe coding using spatial extrapolation2002
- Novel sequential error-concealment techniques using orientation adaptive interpolationIEEE Transactions on Circuits and Systems for Video Technology, 2002
- Coding of segmented images using shape-independent basis functionsIEEE Transactions on Image Processing, 1998
- Concealment of damaged block transform coded images using projections onto convex setsIEEE Transactions on Image Processing, 1995
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- Recovery of lost or erroneously received motion vectors1993