Linearized Transfer Entropy for Continuous Second Order Systems
Open Access
Abstract
The transfer entropy has proven a useful measure of coupling among components of a dynamical system. This measure effectively captures the influence of one system component on the transition probabilities (dynamics) of another. The original motivation for the measure was to quantify such relationships among signals collected from a nonlinear system. However, we have found the transfer entropy to also be a useful concept in describing linear coupling among system components. In this work we derive the analytical transfer entropy for the response of coupled, second order linear systems driven with a Gaussian random process. The resulting expression is a function of the auto- and cross-correlation functions associated with the system response for different degrees-of-freedom. We show clearly that the interpretation of the transfer entropy as a measure of "information flow" is not always valid. In fact, in certain instances the "flow" can appear to switch directions simply by altering the degree of linear coupling. A safer way to view the transfer entropy is as a measure of the ability of a given system component to predict the dynamics of another.Keywords
This publication has 20 references indexed in Scilit:
- Transfer entropy in magnetoencephalographic data: Quantifying information flow in cortical and cerebellar networksProgress in Biophysics and Molecular Biology, 2011
- Transfer entropy—a model-free measure of effective connectivity for the neurosciencesJournal of Computational Neuroscience, 2010
- Application of information theory methods to food web reconstructionEcological Modelling, 2007
- Mapping the Information Landscape: Discerning Peaks and Valleys for Ecological MonitoringJournal of Biological Physics, 2007
- Finding the Direction of Disturbance Propagation in a Chemical Process Using Transfer EntropyIEEE Transactions on Control Systems Technology, 2006
- Examining structural dynamics using information flowProbabilistic Engineering Mechanics, 2006
- Detecting impact damage in experimental composite structures: an information-theoretic approachSmart Materials and Structures, 2006
- Analysing the information flow between financial time seriesThe European Physical Journal B, 2002
- Information transfer in continuous processesPhysica D: Nonlinear Phenomena, 2002
- Measuring Information TransferPhysical Review Letters, 2000