Asymptotic Model Selection for Naive Bayesian Networks

Authors:

Preprint

12 December 2012

preprint
Published by arXiv in arXiv

DOI:10.48550/arXiv.1301.0598

Abstract

We develop a closed form asymptotic formula to compute the marginal likelihood of data given a naive Bayesian network model with two hidden states and binary features. This formula deviates from the standard BIC score. Our work provides a concrete example that the BIC score is generally not valid for statistical models that belong to a stratified exponential family. This stands in contrast to linear and curved exponential families, where the BIC score has been proven to provide a correct approximation for the marginal likelihood.

Keywords

All Related Versions

Version 1, 2012-12-12, ArXiv

This publication has 4 references indexed in Scilit:

Stratified exponential families: Graphical models and model selection
The Annals of Statistics, 2001
Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.
The Journal of Philosophy, 1991
On the Choice of a Model to Fit Data from an Exponential Family
The Annals of Statistics, 1988
A new look at the statistical model identification
IEEE Transactions on Automatic Control, 1974