Breakdown of random matrix universality in Markov models
- 6 August 2021
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 104 (2) , 024305
Abstract
Biological systems need to react to stimuli over a broad spectrum of timescales. If and how this ability can emerge without external fine-tuning is a puzzle. We consider here this problem in discrete Markovian systems, where we can leverage results from random matrix theory. Indeed, generic large transition matrices are governed by universal results, which predict the absence of long timescales unless fine-tuned. We consider an ensemble of transition matrices and motivate a temperature-like variable that controls the dynamic range of matrix elements, which we show plays a crucial role in the applicability of the large matrix limit: as the dynamic range increases, a phase transition occurs whereby the random matrix theory result is avoided, and long relaxation times ensue, in the entire “ordered” phase. We furthermore show that this phase transition is accompanied by a drop in the entropy rate and a peak in complexity, as measured by predictive information [Bialek, Nemenman, and Tishby Neural Comput. 13, 2409 (2001)]. Extending the Markov model to a Hidden Markov model (HMM), we show that observable sequences inherit properties of the hidden sequences, allowing HMMs to be understood in terms of more accessible Markov models. We then apply our findings to fMRI data from 820 human subjects scanned at wakeful rest. We show that the data can be quantitatively understood in terms of the random model, and that brain activity lies close to the phase transition when engaged in unconstrained, task-free cognition—supporting the brain criticality hypothesis in this context.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2020-04762)
- European Research Council (ERC-StG-2019-850404)
This publication has 52 references indexed in Scilit:
- Ongoing Cortical Activity at Rest: Criticality, Multistability, and Ghost AttractorsThe Journal of Neuroscience, 2012
- Circular law theorem for random Markov matricesProbability Theory and Related Fields, 2011
- The ensemble of random Markov matricesJournal of Statistical Mechanics: Theory and Experiment, 2009
- Dynamical synapses causing self-organized criticality in neural networksNature Physics, 2007
- Self-Organized Criticality Model for Brain PlasticityPhysical Review Letters, 2006
- What is a hidden Markov model?Nature Biotechnology, 2004
- Spectra of complex networksPhysical Review E, 2003
- Predictability, Complexity, and LearningNeural Computation, 2001
- Convergent Multiplicative Processes Repelled from Zero: Power Laws and Truncated Power LawsJournal de Physique I, 1997
- Hidden Markov Models for Speech RecognitionTechnometrics, 1991