Validly Interpreting Patients’ Reports
- 1 September 2012
- journal article
- research article
- Published by Wolters Kluwer Health in Medical Care
- Vol. 50, S42-S48
Abstract
Validly interpreting scores based on patients' reports of their experiences using scales depends on a valid scoring system. The possibility exists that, although the creators of a scale intended to create a scale measuring a single construct, the questions may seem to measure more than one construct. However, the possibility also exists that the questions do generally measure one construct, but several "nuisance" constructs influence the measurement of the construct indirectly. Unidimensional, multidimensional, and bifactor analytical models offer a method for establishing scale dimensionality and subsequently developing valid scoring systems. In this paper, we take an applied perspective, discuss these models and their implications, and use real data to provide an example. We used unidimensional, multidimensional, and bifactor analyses to examine the measurement structure of the Consumer Assessments of Healthcare Providers and Systems Cultural Competence (CAHPS-CC) Survey. Participants came from a 2008 sample of 2 Medicaid managed care plans, in New York and California. Both unidimensional and bifactor models failed to fit the data well. A multidimensional model, with 7 factors corresponding to 7 cultural competence domains fit the data well (root mean square error of approximation=0.064; Tucker-Lewis Index=0.98; comparative fit index=0.97). Results indicate that the CAHPS-CC does not seem to measure a single construct. Rather, the CAHPS-CC seems to measure 7 separable domains, suggesting the need for 7 separate scale scores. Our findings highlight the importance of conducting dimensionality analyses.Keywords
This publication has 14 references indexed in Scilit:
- Advances in Measuring Culturally Competent CareMedical Care, 2012
- A Survey of Informatics Platforms That Enable Distributed Comparative Effectiveness Research Using Multi-institutional Heterogenous Clinical DataMedical Care, 2012
- Advancing PROMIS’s methodology: results of the Third Patient-Reported Outcomes Measurement Information System (PROMIS®) Psychometric SummitExpert Review of Pharmacoeconomics & Outcomes Research, 2011
- Target Rotations and Assessing the Impact of Model Violations on the Parameters of Unidimensional Item Response Theory ModelsEducational and Psychological Measurement, 2011
- Bifactor and item response theory analyses of interviewer report scales of cognitive impairment in schizophrenia.Psychological Assessment, 2011
- Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale ScoresJournal of Personality Assessment, 2010
- Alpha, Dimension-Free, and Model-Based Internal Consistency ReliabilityPsychometrika, 2008
- Psychometric Evaluation and Calibration of Health-Related Quality of Life Item BanksMedical Care, 2007
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification.Psychological Methods, 1998