How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias
Authors:
Top Cited Papers
Open Access
- 24 May 2014
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of Public Administration Research and Theory
- Vol. 25 (1) , 285-308
Abstract
Public administration scholars are beginning to pay more attention to the problem of common source bias, but little is known about the approaches that applied researchers are adopting as they attempt to confront the issue in their own research. In this essay, we consider the various responses taken by the authors of six articles in this journal. We draw attention to important nuances of the common measurement issue that have previously received little attention and run a set of empirical analyses in order to test the effectiveness of several proposed solutions to the common-source-bias problem. Our results indicate that none of the statistical remedies being used by public administration scholars appear to be reliable methods of countering the problem. Currently, it appears as though the only reliable solution is to find independent sources of data when perceptual survey measures are employed.Keywords
This publication has 20 references indexed in Scilit:
- Evaluating Urban Public Schools: Parents, Teachers, and State AssessmentsPublic Administration Review, 2013
- Is Discord Detrimental? Using Institutional Variation to Identify the Impact of Public Governing Board Conflict on OutcomesJournal of Public Administration Research and Theory, 2012
- Method Effects, Measurement Error, and Substantive ConclusionsOrganizational Research Methods, 2010
- Perceptions of the policePolicing: An International Journal, 2002
- Response Styles in Marketing Research: A Cross-National InvestigationJournal of Marketing Research, 2001
- Climate quality and climate consensus as mediators of the relationship between organizational antecedents and outcomes.Journal of Applied Psychology, 2000
- Common Methods Bias: Does Common Methods Variance Really Bias Results?Organizational Research Methods, 1998
- Measurement Error and Theory Testing in Consumer Research: An Illustration of the Importance of Construct ValidationJournal of Consumer Research, 1988
- Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation StudiesJournal of Marketing Research, 1987
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959