Integrated information in the thermodynamic limit
Authors:
Preprint
Abstract
The capacity to integrate information is a prominent feature of biological and cognitive systems. Integrated Information Theory (IIT) provides a mathematical approach to quantify the level of integration in a system, yet its computational cost generally precludes its applications beyond relatively small models. In consequence, it is not yet well understood how integration scales up with the size of a system or with different temporal scales of activity, nor how a system maintains its integration as its interacts with its environment. Here, we show for the first time how measures of information integration scale when systems become very large. Using kinetic Ising models and mean-field approximations from statistical mechanics, we show that information integration diverges in the thermodynamic limit at certain critical points. Moreover, by comparing different divergent tendencies of blocks of a system at these critical points, we delimit the boundary between an integrated unit and its environment. Finally, we present a model that adaptively maintains its integration despite changes in its environment by generating a critical surface where its integrity is preserved. We argue that the exploration of integrated information for these limit cases helps in addressing a variety of poorly understood questions about the organization of biological, neural, and cognitive systems.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Adaptation to criticality through organizational invariance in embodied agentsScientific Reports, 2018
- Can the macro beat the micro? Integrated information across spatiotemporal scalesNeuroscience of Consciousness, 2016
- Griffiths phases and the stretching of criticality in brain networksNature Communications, 2013
- Principles of maximum entropy and maximum caliber in statistical physicsReviews of Modern Physics, 2013
- The algorithmic origins of lifeJournal of The Royal Society Interface, 2013
- Practical Measures of Integrated Information for Time-Series DataPLOS Computational Biology, 2011
- The Microbial Genetic Algorithm2011
- Autonomy: An information theoretic perspectiveBioSystems, 2008
- Commentary on: “Piaget's stages: the unfinished symphony of cognitive development” by D.H. FeldmanNew Ideas in Psychology, 2004
- A Simplex Method for Function MinimizationThe Computer Journal, 1965