Stochastic Models for Sparse and Piecewise-Smooth Signals
Authors:
- 11 November 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 59 (3) , 989-1006
Abstract
We introduce an extended family of continuous-domain stochastic models for sparse, piecewise-smooth signals. These are specified as solutions of stochastic differential equations, or, equivalently, in terms of a suitable innovation model; the latter is analogous conceptually to the classical interpretation of a Gaussian stationary process as filtered white noise. The two specific features of our approach are 1) signal generation is driven by a random stream of Dirac impulses (Poisson noise) instead of Gaussian white noise, and 2) the class of admissible whitening operators is considerably larger than what is allowed in the conventional theory of stationary processes. We provide a complete characterization of these finite-rate-of-innovation signals within Gelfand's framework of generalized stochastic processes. We then focus on the class of scale-invariant whitening operators which correspond to unstable systems. We show that these can be solved by introducing proper boundary conditions, which leads to the specification of random, spline-type signals that are piecewise-smooth. These processes are the Poisson counterpart of fractional Brownian motion; they are nonstationary and have the same 1/ω-type spectral signature. We prove that the generalized Poisson processes have a sparse representation in a wavelet-like basis subject to some mild matching condition. We also present a limit example of sparse process that yields a MAP signal estimator that is equivalent to the popular TV-denoising algorithm.Keywords
This publication has 39 references indexed in Scilit:
- Left-inverses of fractional Laplacian and sparse stochastic processesAdvances in Computational Mathematics, 2011
- Invariances, Laplacian-Like Wavelet Bases, and the Whitening of Fractal ProcessesIEEE Transactions on Image Processing, 2009
- Self-Similarity: Part II—Optimal Estimation of Fractal ProcessesIEEE Transactions on Signal Processing, 2007
- Self-Similarity: Part I—Splines and OperatorsIEEE Transactions on Signal Processing, 2007
- An Introduction to Statistical Signal Processing2004
- Power spectra of general shot noises and Hawkes point processes with a random excitationAdvances in Applied Probability, 2002
- nth-order fractional Brownian motion and fractional Gaussian noisesIEEE Transactions on Signal Processing, 2001
- On generalized shot noiseAdvances in Applied Probability, 1977
- Splines minimizing rotation-invariant semi-norms in Sobolev spaces1977
- Fractional Brownian Motions, Fractional Noises and ApplicationsSIAM Review, 1968