Bayesian paired comparison with the bpcs package
Open Access
- 30 November 2021
- journal article
- research article
- Published by Springer Nature in Behavior Research Methods
- Vol. 54 (4) , 2025-2045
Abstract
This article introduces the R package (Bayesian Paired Comparison in Stan) and the statistical models implemented in the package. This package aims to facilitate the use of Bayesian models for paired comparison data in behavioral research. Bayesian analysis of paired comparison data allows parameter estimation even in conditions where the maximum likelihood does not exist, allows easy extension of paired comparison models, provides straightforward interpretation of the results with credible intervals, has better control of type I error, has more robust evidence towards the null hypothesis, allows propagation of uncertainties, includes prior information, and performs well when handling models with many parameters and latent variables. The package provides a consistent interface for R users and several functions to evaluate the posterior distribution of all parameters to estimate the posterior distribution of any contest between items and to obtain the posterior distribution of the ranks. Three reanalyses of recent studies that used the frequentist Bradley–Terry model are presented. These reanalyses are conducted with the Bayesian models of the package, and all the code used to fit the models, generate the figures, and the tables are available in the online appendix.Keywords
All Related Versions
Funding Information
- Chalmers University of Technology
This publication has 48 references indexed in Scilit:
- Understanding predictive information criteria for Bayesian modelsStatistics and Computing, 2013
- Role Preferences of People with Multiple Sclerosis: Image-Revised, Computerized Self-Administered Version of the Control Preference ScalePLOS ONE, 2013
- Models for Paired Comparison Data: A Review with Emphasis on Dependent DataStatistical Science, 2012
- Efficient Bayesian Inference for Generalized Bradley–Terry ModelsJournal of Computational and Graphical Statistics, 2012
- Item Response Modeling of Forced-Choice QuestionnairesEducational and Psychological Measurement, 2011
- Hierarchical modeling of paired comparison data.Psychological Methods, 2001
- The use and adaptation of the paired-comparison method in the sensory evaluation of hamburger-type patties by illiterate/semi-literate consumersFood Quality and Preference, 1996
- On Extending the Bradley-Terry Model to Incorporate Within-Pair Order EffectsBiometrics, 1977
- On Extending the Bradley-Terry Model to Accommodate Ties in Paired Comparison ExperimentsJournal of the American Statistical Association, 1970
- Rank Analysis of Incomplete Block Designs: I. The Method of Paired ComparisonsBiometrika, 1952