Sparse model selection in the highly under-sampled regime
- 1 September 2016
- journal article
- Published by IOP Publishing in Journal of Statistical Mechanics: Theory and Experiment
- Vol. 2016 (9) , 093404
Abstract
We propose a method for recovering the structure of a sparse undirected graphical model when very few samples are available. The method decides about the presence or absence of bonds between pairs of variable by considering one pair at a time and using a closed form formula, analytically derived by calculating the posterior probability for every possible model explaining a two body system using Jeffreys prior. The approach does not rely on the optimization of any cost functions and consequently is much faster than existing algorithms. Despite this time and computational advantage, numerical results show that for several sparse topologies the algorithm is comparable to the best existing algorithms, and is more accurate in the presence of hidden variables. We apply this approach to the analysis of US stock market data and to neural data, in order to show its efficiency in recovering robust statistical dependencies in real data with non-stationary correlations in time and/or space.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methodsJournal of Statistical Mechanics: Theory and Experiment, 2012
- Inverse Ising Inference Using All the DataPhysical Review Letters, 2012
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy DataPhysical Review Letters, 2011
- Ising model for neural data: Model quality and approximate methods for extracting functional connectivityPhysical Review E, 2009
- Compressed sensingIEEE Transactions on Information Theory, 2006
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996
- A Learning Algorithm for Boltzmann Machines*Cognitive Science, 1985
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Approximating discrete probability distributions with dependence treesIEEE Transactions on Information Theory, 1968