Information Theory for Non-Stationary Processes with Stationary Increments
Open Access
Abstract
We describe how to analyze the wide class of non-stationary processes with stationary centered increments using Shannon information theory. To do so, we use a practical viewpoint and define ersatz quantities from time-averaged probability distributions. These ersatz versions of entropy, mutual information, and entropy rate can be estimated when only a single realization of the process is available. We abundantly illustrate our approach by analyzing Gaussian and non-Gaussian self-similar signals, as well as multi-fractal signals. Using Gaussian signals allows us to check that our approach is robust in the sense that all quantities behave as expected from analytical derivations. Using the stationarity (independence on the integration time) of the ersatz entropy rate, we show that this quantity is not only able to fine probe the self-similarity of the process, but also offers a new way to quantify the multi-fractality.Keywords
All Related Versions
Funding Information
- LABEX iMUST (ANR-10-LABX-0064)
- Agence Nationale de la Recherche (ANR-11-IDEX-0007)
This publication has 40 references indexed in Scilit:
- Probing High-Order Dependencies With Information TheoryIEEE Transactions on Signal Processing, 2019
- A non-stationary stochastic ensemble generator for radar rainfall fields based on the short-space Fourier transformHydrology and Earth System Sciences, 2017
- Assessing Coupling Dynamics from an Ensemble of Time SeriesEntropy, 2015
- Time-Frequency Processing of Nonstationary Signals: Advanced TFD Design to Aid Diagnosis with Highlights from Medical ApplicationsIEEE Signal Processing Magazine, 2013
- On the characterization of non-stationary chaotic systems: Autonomous and non-autonomous casesPhysica A: Statistical Mechanics and its Applications, 2010
- Information in the Nonstationary CaseNeural Computation, 2009
- Identifying Nonstationarity in Turbulence SeriesBoundary-Layer Meteorology, 2007
- On processes with summable partial autocorrelationsStatistics & Probability Letters, 2007
- Time‐variable parameter and trend estimation in non‐stationary economic time seriesJournal of Forecasting, 1994
- Forecasting Non-Stationary Economic Time SeriesManagement Science, 1966