Quantifying Redundant Information in Predicting a Target Random Variable
Open Access
Abstract
We consider the problem of defining a measure of redundant information that quantifies how much common information two or more random variables specify about a target random variable. We discussed desired properties of such a measure, and propose new measures with some desirable properties.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Quantifying Unique InformationEntropy, 2014
- Intersection Information Based on Common RandomnessEntropy, 2014
- Quantifying Synergistic Mutual Information2014
- Bivariate measure of redundant informationPhysical Review E, 2013
- Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical FrameworkPLOS Computational Biology, 2008
- Computational analysis of the synergy among multiple interacting genesMolecular Systems Biology, 2007
- Redundancy and Synergy of Neuronal Ensembles in Motor CortexJournal of Neuroscience, 2005
- Synergy, Redundancy, and Independence in Population CodesThe Journal of Neuroscience, 2003
- Network Information and Connected CorrelationsPhysical Review Letters, 2003
- The common information of two dependent random variablesIEEE Transactions on Information Theory, 1975