Not Seeing Clearly With Cleary: What Test Bias Analyses Do and Do Not Tell Us
Authors:
- Adam W. MeadeAMAdam W. Meade
- Scott TonidandelSTScott Tonidandel
- 1 June 2010
- journal article
- Published by Cambridge University Press (CUP) in Industrial and Organizational Psychology
- Vol. 3 (2) , 192-205
Abstract
In recent decades, the Cleary (1968) approach for testing for differences in regression lines among demographic groups has been codified as a central approach to evaluate a test for bias. However, this approach is fraught with numerous shortcomings, a preponderance of implicit assumptions, and outcomes that are not sufficient to conclude that there is a problem with a test. We believe these shortcomings are poorly understood by many industrial–organizational (I–O) psychologists, that this method for evaluating test bias is overrelied on by our profession, and that it is interpreted improperly by those wishing to evaluate tests for bias in applied settings. Moreover, eliminating differential prediction may be impossible in some cases, undesirable in others, and places an undue burden on organizational researchers.Keywords
This publication has 25 references indexed in Scilit:
- Revival of test bias research in preemployment testing.Journal of Applied Psychology, 2010
- A Generalized Solution for Approximating the Power to Detect Effects of Categorical Moderator Variables Using Multiple RegressionOrganizational Research Methods, 2001
- Determinants, Detection and Amelioration of Adverse Impact in Personnel Selection Procedures: Issues, Evidence and Lessons LearnedInternational Journal of Selection and Assessment, 2001
- Longitudinal assessment of applicant reactions to employment testing and test outcome feedback.Journal of Applied Psychology, 1998
- Methodological artifacts in moderated multiple regression and their effects on statistical power.Journal of Applied Psychology, 1997
- Group Differences and Personnel Decisions: Validity, Fairness, and Affirmative ActionJournal of Vocational Behavior, 1996
- Critical analysis of the statistical and ethical implications of various definitions of test bias.Psychological Bulletin, 1976
- On so-called test bias.American Psychologist, 1975
- BIAS IN SELECTIONJournal of Educational Measurement, 1973
- ANOTHER LOOK AT “CULTURAL FAIRNESS”1Journal of Educational Measurement, 1971