From information scaling of natural images to regimes of statistical models
Authors:
Open Access
- 5 December 2007
- journal article
- Published by American Mathematical Society (AMS) in Quarterly of Applied Mathematics
- Vol. 66 (1) , 81-122
Abstract
Vision can be considered a highly specialized data collection and analysis problem. We need to understand the special properties of natural image data in order to construct statistical models and develop statistical methods for representing and recognizing the wide variety of natural image patterns. One fundamental property of natural image data that distinguishes vision from other sensory tasks such as speech recognition is that scale plays a profound role in image formation and interpretation. Specifically, visual objects can appear at a wide range of scales in the images due to the change of viewing distance as well as camera resolution. The same objects appearing at different scales produce different image data with different statistical properties. In particular, we show that the entropy rate of the image data changes over scale. Moreover, the inferential uncertainty changes over scale too. We call these changes information scaling. We then examine both empirically and theoretically two prominent and yet largely isolated classes of image models, namely, wavelet sparse coding models and Markov random field models. Our results indicate that the two classes of models are appropriate for two different entropy regimes: sparse coding targets low entropy regimes, whereas Markov random fields are appropriate for high entropy regimes. Because information scaling connects different entropy regimes, both sparse coding and Markov random fields are necessary for representing natural image data, and information scaling triggers transitions between these two regimes. This motivates us to propose a modeling scheme that embraces both regimes of models in a common framework. The contribution of our work is two-fold. First, the study of information scaling provides a unifying perspective for the rich variety of natural image patterns. Second, the modeling scheme that we develop provides a natural integration of different regimes of image models.Keywords
This publication has 47 references indexed in Scilit:
- Composition systemsQuarterly of Applied Mathematics, 2002
- Mathematical Models for Local Nontexture InpaintingsSIAM Journal on Applied Mathematics, 2002
- Elements of Information Theory2001
- Stochastic models for generic imagesQuarterly of Applied Mathematics, 2001
- Data compression and harmonic analysisIEEE Transactions on Information Theory, 1998
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Introduction to Modern Statistical MechanicsPhysics Today, 1988
- Entropy and the Central Limit TheoremThe Annals of Probability, 1986
- Random Sets and Integral Geometry.Journal of the Royal Statistical Society. Series A (General), 1976
- Spatial Interaction and the Statistical Analysis of Lattice SystemsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1974