Bayesian Assessment of Null Values Via Parameter Estimation and Model Comparison
- 18 May 2011
- journal article
- review article
- Published by SAGE Publications in Perspectives on Psychological Science
- Vol. 6 (3) , 299-312
Abstract
Psychologists have been trained to do data analysis by asking whether null values can be rejected. Is the difference between groups nonzero? Is choice accuracy not at chance level? These questions have been traditionally addressed by null hypothesis significance testing (NHST). NHST has deep problems that are solved by Bayesian data analysis. As psychologists transition to Bayesian data analysis, it is natural to ask how Bayesian analysis assesses null values. The article explains and evaluates two different Bayesian approaches. One method involves Bayesian model comparison (and uses Bayes factors). The second method involves Bayesian parameter estimation and assesses whether the null value falls among the most credible values. Which method to use depends on the specific question that the analyst wants to answer, but typically the estimation approach (not using Bayes factors) provides richer information than the model comparison approach.Keywords
This publication has 17 references indexed in Scilit:
- Bayesian Versus Orthodox Statistics: Which Side Are You On?Perspectives on Psychological Science, 2011
- Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect.Journal of Personality and Social Psychology, 2011
- Prior sensitivity in theory testing: An apologia for the Bayes factorJournal of Mathematical Psychology, 2010
- What to believe: Bayesian methods for data analysisTrends in Cognitive Sciences, 2010
- Bayesian t tests for accepting and rejecting the null hypothesisPsychonomic Bulletin & Review, 2009
- Bayes factors: Prior sensitivity and model generalizabilityJournal of Mathematical Psychology, 2008
- Bayesian statistical inference in psychology: Comment on Trafimow (2003).Psychological Review, 2005
- The Selection of Prior Distributions by Formal RulesJournal of the American Statistical Association, 1996
- Bayesian Approaches to Randomized TrialsJournal of the Royal Statistical Society Series A: Statistics in Society, 1994
- Fixed-Sample-Size Analysis of Sequential ObservationsBiometrics, 1954