Synergy, redundancy, and multivariate information measures: an experimentalist’s perspective
Authors:
Top Cited Papers
- 3 July 2013
- journal article
- review article
- Published by Springer Nature in Journal of Computational Neuroscience
- Vol. 36 (2) , 119-140
Abstract
Information theory has long been used to quantify interactions between two variables. With the rise of complex systems research, multivariate information measures have been increasingly used to investigate interactions between groups of three or more variables, often with an emphasis on so called synergistic and redundant interactions. While bivariate information measures are commonly agreed upon, the multivariate information measures in use today have been developed by many different groups, and differ in subtle, yet significant ways. Here, we will review these multivariate information measures with special emphasis paid to their relationship to synergy and redundancy, as well as examine the differences between these measures by applying them to several simple model systems. In addition to these systems, we will illustrate the usefulness of the information measures by analyzing neural spiking data from a dissociated culture through early stages of its development. Our aim is that this work will aid other researchers as they seek the best multivariate information measure for their specific research goals and system. Finally, we have made software available online which allows the user to calculate all of the information measures discussedwithin this paper.Keywords
This publication has 89 references indexed in Scilit:
- Transfer entropy—a model-free measure of effective connectivity for the neurosciencesJournal of Computational Neuroscience, 2010
- Information-geometric measure of 3-neuron firing patterns characterizes scale-dependence in cortical networksJournal of Computational Neuroscience, 2010
- Sparse coding and high-order correlations in fine-scale cortical networksNature, 2010
- The minimum information principle and its application to neural code analysisProceedings of the National Academy of Sciences, 2009
- Spatio-temporal correlations and visual signalling in a complete neuronal populationNature, 2008
- Behavior-dependent short-term assembly dynamics in the medial prefrontal cortexNature Neuroscience, 2008
- Precisely timed spatiotemporal patterns of neural activity in dissociated cortical culturesNeuroscience, 2007
- Network structure of cerebral cortex shapes functional connectivity on multiple time scalesProceedings of the National Academy of Sciences, 2007
- Computational analysis of the synergy among multiple interacting genesMolecular Systems Biology, 2007
- Weak pairwise correlations imply strongly correlated network states in a neural populationNature, 2006