Evaluation of Wine Judge Performance through Three Characteristics: Bias, Discrimination, and Variation
Authors:
- 1 January 2010
- journal article
- research article
- Published by Cambridge University Press (CUP) in Journal of Wine Economics
- Vol. 5 (1) , 132-142
Abstract
Judge performance is a critical component of a wine competition's success. A number of studies have shown that wine judges may differ considerably in their opinions. In this paper, we have conducted an in-depth examination of wine judge performance at a U.S. wine competition. Three characteristics of judge's performance are examined: bias, discrimination ability, and variation. Based on the analysis, we can identify the judges who had discrepant scoring patterns and can gain insight into which of the three characteristics cause particular judges to disagree. The evaluation of wine judge performance through these three characteristics may provide useful information for training them to have consistent performance and in assisting competition coordinators in judge selection. (JEL Classification: C1, D8, Q13)Keywords
This publication has 13 references indexed in Scilit:
- A Bayesian Approach to Ranking and Rater EvaluationJournal of Educational and Behavioral Statistics, 2010
- An Analysis of the Concordance Among 13 U.S. Wine CompetitionsJournal of Wine Economics, 2009
- An Examination of Judge Reliability at a major U.S. Wine CompetitionJournal of Wine Economics, 2008
- The Paris 1976 Wine Tastings Revisited Once More: Comparing Ratings of Consistent and Inconsistent TastersJournal of Wine Economics, 2006
- Who won the 1976 blind tasting of French Bordeaux and US Cabernets? Parametrics to the rescueJournal of Wine Research, 2004
- EVALUATION OF WINE COMPETITION JUDGE PERFORMANCE USING PRINCIPAL COMPONENT SIMILARITY ANALYSISJournal of Sensory Studies, 2001
- Ordinal Data ModelingJournal of the American Statistical Association, 2000
- The evaluation of judges at wine competitions: the application of Eggshell plotsJournal of Wine Research, 1997
- A proposed approach for evaluating expert wine judge performance using descriptive statisticsJournal of Wine Research, 1996
- Condorcet's Theory of VotingAmerican Political Science Review, 1988