Granger Causality Networks for Categorical Time Series
Preprint
Abstract
We present a new framework for learning Granger causality networks for multivariate categorical time series, based on the mixture transition distribution (MTD) model. Traditionally, MTD is plagued by a nonconvex objective, non-identifiability, and presence of many local optima. To circumvent these problems, we recast inference in the MTD as a convex problem. The new formulation facilitates the application of MTD to high-dimensional multivariate time series. As a baseline, we also formulate a multi-output logistic autoregressive model (mLTD), which while a straightforward extension of autoregressive Bernoulli generalized linear models, has not been previously applied to the analysis of multivariate categorial time series. We develop novel identifiability conditions of the MTD model and compare them to those for mLTD. We further devise novel and efficient optimization algorithm for the MTD based on the new convex formulation, and compare the MTD and mLTD in both simulated and real data experiments. Our approach simultaneously provides a comparison of methods for network inference in categorical time series and opens the door to modern, regularized inference with the MTD model.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- A New Model for Multivariate Markov ChainsScandinavian Journal of Statistics, 2014
- Discovering graphical Granger causality using the truncating lasso penaltyBioinformatics, 2010
- An EM algorithm for estimation in the mixture transition distribution modelJournal of Statistical Computation and Simulation, 2008
- The Mixture Transition Distribution Model for High-Order Markov Chains and Non-Gaussian Time SeriesStatistical Science, 2002
- A multivariate Markov chain model for categorical data sequences and its applications in demand predictionsIMA Journal of Management Mathematics, 2002
- Estimation in the Mixture Transition Distribution ModelJournal of Time Series Analysis, 2001