Marketing measurement revolution
Author:
- 15 November 2011
- journal article
- e conceptual-paper
- Published by Emerald Publishing in European Journal of Marketing
- Vol. 45 (11/12) , 1561-1588
Abstract
Purpose: New measures in marketing are invariably created by using a psychometric approach based on Churchill's “scale development” procedure. This paper aims to compare and contrast Churchill's procedure with Rossiter's content‐validity approach to measurement, called C‐OAR‐SE.Design/methodology approach: The comparison of the two procedures is by rational argument and forms the theoretical first half of the paper. In the applied second half of the paper, three recent articles from theJournal of Marketing(JM) that introduce new constructs and measures are criticized and corrected from the C‐OAR‐SE perspective.Findings: The C‐OAR‐SE method differs from Churchill's method by arguing for: total emphasis on achieving high content validity of the item(s) and answer scale – without which nothing else matters; use of single‐item measures for “basic” constructs and for the first‐order components of “abstract” constructs; abandonment of the “reflective” measurement model, along with its associated statistical techniques of factor analysis and coefficient alpha, arguing that all abstract constructs must be measured as “formative”; and abandonment of external validation methods, notably multitrait‐multimethod analysis (MTMM) and structural equation modeling (SEM), to be replaced by internal content‐validation of the measure itself. The C‐OAR‐SE method can be applied – as demonstrated in the last part of the article – by any verbally intelligent researcher. However, less confident researchers may need to seek the assistance of one or two colleagues who fully understand the new method.Practical implications: If a measure is not highly content‐valid to begin with – and none of the new measures in theJMarticles criticized is highly content‐valid – then no subsequent psychometric properties can save it. Highly content‐valid measures are absolutely necessary for proper tests of theories and hypotheses, and for obtaining trustworthy findings in marketing.Originality/value: C‐OAR‐SE is completely original and Rossiter's updated version should be followed. C‐OAR‐SE is leading the necessary marketing measurement revolution.Keywords
This publication has 40 references indexed in Scilit:
- Creating lift versus building the base: Current trends in marketing dynamicsInternational Journal of Research in Marketing, 2009
- The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same ConstructsJournal of Marketing Research, 2007
- Maximum versus meaningful discrimination in scale response:Journal of Business Research, 2004
- The use of expert judges in scale developmentJournal of Business Research, 2004
- The C-OAR-SE procedure for scale development in marketingInternational Journal of Research in Marketing, 2002
- The Five Forms of Transmissible, Usable marketing KnowledgeMarketing Theory, 2002
- What Is Marketing Knowledge?Marketing Theory, 2001
- Derivation of Theory by Means of Factor Analysis or Tom Swift and His Electric Factor Analysis MachineThe American Statistician, 1967
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951