A Sparsification Approach for Temporal Graphical Model Decomposition
- 1 December 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2009, 447-456
Abstract
Temporal causal modeling can be used to recover the causal structure among a group of relevant time series variables. Several methods have been developed to explicitly construct temporal causal graphical models. However, how to best understand and conceptualize these complicated causal relationships is still an open problem. In this paper, we propose a decomposition approach to simplify the temporal graphical model. Our method clusters time series variables into groups such that strong interactions appear among the variables within each group and weak (or no) interactions exist for cross-group variable pairs. Specifically, we formulate the clustering problem for temporal graphical models as a regression-coefficient sparsification problem and define an interesting objective function which balances the model prediction power and its cluster structure. We introduce an iterative optimization approach utilizing the Quasi-Newton method and generalized ridge regression to minimize the objective function and to produce a clustered temporal graphical model. We also present a novel optimization procedure utilizing a graph theoretical tool based on the maximum weight independent set problem to speed up the Quasi-Newton method for a large number of variables. Finally, our detailed experimental study on both synthetic and real datasets demonstrates the effectiveness of our methods.Keywords
This publication has 14 references indexed in Scilit:
- A scalable framework for cluster ensemblesPattern Recognition, 2009
- GRANGER CAUSALITY BETWEEN MULTIPLE INTERDEPENDENT NEUROBIOLOGICAL TIME SERIES: BLOCKWISE VERSUS PAIRWISE METHODSInternational Journal of Neural Systems, 2007
- Granger causality and path diagrams for multivariate time seriesJournal of Econometrics, 2007
- Graphical Models for the Identification of Causal Structures in Multivariate Time Series Models2006
- Clustering of time series data—a surveyPattern Recognition, 2005
- Learning from labeled and unlabeled data on a directed graph2005
- Clustering time series from ARMA models with clipped data2004
- Community structure in social and biological networksProceedings of the National Academy of Sciences, 2002
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Investigating Causal Relations by Econometric Models and Cross-spectral MethodsEconometrica, 1969