Sparse model selection in the highly under-sampled regime
Preprint
Abstract
We propose a method for recovering the structure of a sparse undirected graphical model when very few samples are available. The method decides about the presence or absence of bonds between pairs of variable by considering one pair at a time and using a closed form formula, analytically derived by calculating the posterior probability for every possible model explaining a two body system using Jeffreys prior. The approach does not rely on the optimisation of any cost functions and consequently is much faster than existing algorithms. Despite this time and computational advantage, numerical results show that for several sparse topologies the algorithm is comparable to the best existing algorithms, and is more accurate in the presence of hidden variables. We apply this approach to the analysis of US stock market data and to neural data, in order to show its efficiency in recovering robust statistical dependencies in real data with non stationary correlations in time and space.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Learning and inference in a nonequilibrium Ising model with hidden nodesPhysical Review E, 2013
- The entorhinal grid map is discretizedNature, 2012
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methodsJournal of Statistical Mechanics: Theory and Experiment, 2012
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy DataPhysical Review Letters, 2011
- Mean Field Theory for Nonequilibrium Network ReconstructionPhysical Review Letters, 2011
- Ising model for neural data: Model quality and approximate methods for extracting functional connectivityPhysical Review E, 2009
- Dynamic instability in generic model of multi-assets marketsJournal of Economic Dynamics and Control, 2009
- Theory of Financial Risk and Derivative Pricing2003
- Counting probability distributions: Differential geometry and model selectionProceedings of the National Academy of Sciences of the United States of America, 2000
- An invariant form for the prior probability in estimation problemsProceedings of the Royal Society of London. A. Mathematical and Physical Sciences, 1946