Are We Correcting Correctly?
Authors:
- 13 January 2015
- journal article
- Published by SAGE Publications in Organizational Research Methods
- Vol. 18 (3) , 355-428
Abstract
The formulae for attenuation correction in meta-analysis treat reliabilities as if they were independent of each other. The current study puts this assumption of independence to the test by empirically examining the correlation among predictor and criterion reliability estimates across studies. Interdependence of reliabilities would result in either overestimation or underestimation of population correlations depending on the direction of the relationship between the reliabilities. We conducted two studies to examine the extent to which predictor and criterion reliabilities correlate across studies. Study 1 is based on 628 pairs of reliability estimates from 518 studies published in the Academy of Management Journal and the Journal of Applied Psychology between 2004 and 2011, while Study 2 is based on 564 pairs of reliability estimates from 347 studies included in a meta-analysis on perceived organizational support (POS) and some of its antecedents and outcomes. The findings in both studies show substantial correlations between predictor and criterion reliability coefficients across studies. Our article discusses important implications from these findings for future research and for the future conduct of meta-analyses.Keywords
This publication has 614 references indexed in Scilit:
- Predicting the job and life satisfaction of Italian teachers: Test of a social cognitive modelJournal of Vocational Behavior, 2011
- Why does mentoring work? The role of perceived organizational supportJournal of Vocational Behavior, 2010
- A meta-analysis of the relationship between perceived organizational support and job outcomes: 20 years of researchJournal of Business Research, 2009
- Reporting standards for research in psychology: Why do we need them? What might they be?American Psychologist, 2008
- Mobility norms, risk aversion, and career satisfaction of Chinese employeesAsia Pacific Journal of Management, 2008
- Antecedents and consequences of the frequency of upward and downward social comparisons at workOrganizational Behavior and Human Decision Processes, 2007
- Affective commitment to the organization: The contribution of perceived organizational support.Journal of Applied Psychology, 2001
- Job satisfaction among detention officersJournal of Criminal Justice, 2001
- Organizational politics and organizational support as predictors of work attitudes, job performance, and organizational citizenship behaviorJournal of Organizational Behavior, 1999
- The theory of test validity and correlated errors of measurementJournal of Mathematical Psychology, 1977