Abstract
Ratings are widely and frequently used in sensory analysis. However, ratings from different methods cannot be treated equivalently because they represent different types of data generated from different cognitive mechanisms. Ignoring this fact may lead to misleading conclusions about true sensory difference or treatment effects obtained from the ratings data analysis. The receiver operating characteristic (ROC) curve in signal detection theory is used in this paper to model the ratings of theA‐NotAand the same–different methods.This paper comprehensively discusses statistical analysis of theROCcurves for the methods, including presentations of theROCcurve functions, estimations ofd′s and their variances, goodness‐of‐fit tests, difference and similarity tests, testing powers and sample sizes, etc. The paper also discusses alternative indices of sensory difference derived from theROCcurve, including theR‐index andGini index. It is appealing to rethink the significance of theR‐index, not only as a powerful test statistic but also as a useful sensory measure.Rfunctions are provided for implementing all the analyses discussed in the paper.Practical Applications: This paper provides a variety of approaches and R functions for statistical analysis for the ratings of theA–NotA, and the ratings of the same–different methods. The measures ofd′s and other indices, which are method‐independent measures of sensory differences and treatment effects, can be estimated from different types of ratings data.

This publication has 52 references indexed in Scilit: