Deviance Information Criterion (DIC)
Author:
- 5 August 2016
- book chapter
- Published by Wiley
- p. 1-6
Abstract
The deviance information criterion (DIC) was introduced in 2002 by Spiegelhalteret al. to compare the relative fit of a set of Bayesian hierarchical models. It is similar to Akaike's information criterion (AIC) in combining a measure of goodness‐of‐fit and measure of complexity, both based on the deviance. While AIC uses the maximum likelihood estimate, DIC's plug‐in estimate is based on the posterior mean. As the number of independent parameters in a Bayesian hierarchical model is not clearly defined, DIC estimates the effective number of parameters by the difference of the posterior mean of the deviance and the deviance at the posterior mean. This coincides with the number of independent parameters in fixed effect models with flat priors, thus the DIC is a generalization of AIC. It can be justified as an estimate of the posterior predictive model performance within a decision‐theoretic framework and it is asymptotically equivalent to leave‐one‐out cross‐validation. The DIC has been used extensively for practical model comparison in many disciplines and works well for exponential family models but due to its dependence on the parametrization and focus of a model, its application to mixture models is problematic.Keywords
This publication has 18 references indexed in Scilit:
- Understanding predictive information criteria for Bayesian modelsStatistics and Computing, 2013
- A Bayesian view of model complexityStatistica Neerlandica, 2012
- A survey of Bayesian predictive methods for model assessment, selection and comparisonStatistics Surveys, 2012
- Making and Evaluating Point ForecastsJournal of the American Statistical Association, 2011
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- Bayesian Measures of Model Complexity and FitJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibilityStatistics and Computing, 2000
- A Predictive Approach to Model SelectionJournal of the American Statistical Association, 1979
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951