A Unified Formulation of Gaussian Versus Sparse Stochastic Processes—Part I: Continuous-Domain Theory
Authors:
Open Access
- 9 January 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 60 (3) , 1945-1962
Abstract
We introduce a general distributional framework that results in a unifying description and characterization of a rich variety of continuous-time stochastic processes. The cornerstone of our approach is an innovation model that is driven by some generalized white noise process, which may be Gaussian or not (e.g., Laplace, impulsive Poisson, or alpha stable). This allows for a conceptual decoupling between the correlation properties of the process, which are imposed by the whitening operator L, and its sparsity pattern, which is determined by the type of noise excitation. The latter is fully specified by a Lévy measure. We show that the range of admissible innovation behavior varies between the purely Gaussian and super-sparse extremes. We prove that the corresponding generalized stochastic processes are well-defined mathematically provided that the (adjoint) inverse of the whitening operator satisfies some Lp bound for p ≥ 1. We present a novel operator-based method that yields an explicit characterization of all Lévy-driven processes that are solutions of constant-coefficient stochastic differential equations. When the underlying system is stable, we recover the family of stationary continuous-time autoregressive moving average processes (CARMA), including the Gaussian ones. The approach remains valid when the system is unstable and leads to the identification of potentially useful generalizations of the Lévy processes, which are sparse and non-stationary. Finally, we show that these processes admit a sparse representation in some matched wavelet domain and provide a full characterization of their transform-domain statistics.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- On the Linearity of Bayesian Interpolators for Non-Gaussian Continuous-Time AR(1) ProcessesIEEE Transactions on Information Theory, 2013
- Sparse Stochastic Processes and Discretization of Linear Inverse ProblemsIEEE Transactions on Image Processing, 2013
- Lévy Processes and Stochastic Calculus2009
- From differential equations to the construction of new wavelet-like basesIEEE Transactions on Signal Processing, 2006
- An Introduction to Statistical Signal Processing2004
- Infinite Divisibility of Probability Distributions on the Real Line2003
- Generation and analysis of non-Gaussian Markov time seriesIEEE Transactions on Signal Processing, 1992
- On the approximation of the discrete Karhunen-Loeve transform for stationary processesSignal Processing, 1984
- Positive definite functions and generalizations, an historical surveyRocky Mountain Journal of Mathematics, 1976
- Discrete Cosine TransformIEEE Transactions on Computers, 1974