Are Internet and Paper-and-Pencil Personality Tests Truly Comparable?
Authors:
- 1 April 2007
- journal article
- Published by SAGE Publications in Organizational Research Methods
- Vol. 10 (2) , 322-345
Abstract
Recently, the use of technology in assessment for personnel selection has increased dramatically. An important consideration is whether test scores obtained via Internet administration are psychometrically equivalent to those obtained by the more traditional paper-and-pencil format. Our results suggest that there is comparability of scores for many personality constructs, including conscientiousness. However, invariance was not found for some scales between persons allowed to choose formats and those not given a choice of formats. As testing-format preference may be related to membership in federally protected demographic groups, this latter finding was somewhat troubling. Additionally, we illustrate the use of an experimental laboratory design to investigate possible causes of a lack of measurement invariance in Internet and paper-and-pencil comparisons.Keywords
This publication has 56 references indexed in Scilit:
- Online Testing: Mode of Administration and the Stability of OPQ 32i ScoresInternational Journal of Selection and Assessment, 2004
- The Effects of Item Parceling on Goodness-of-Fit and Parameter Estimate Bias in Structural Equation ModelingStructural Equation Modeling: A Multidisciplinary Journal, 2002
- Personality Predictors of Citizenship PerformanceInternational Journal of Selection and Assessment, 2001
- A General Approach for Representing Constructs in Organizational ResearchOrganizational Research Methods, 1998
- An evaluation of the psychometric properties of the concept 5.2 Occupational Personality QuestionnaireJournal of Occupational and Organizational Psychology, 1996
- Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?Journal of Applied Psychology, 1992
- THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSISPersonnel Psychology, 1991
- Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance.Psychological Bulletin, 1989
- Structural equation modeling in practice: A review and recommended two-step approach.Psychological Bulletin, 1988
- The Effect of Sampling Error on Convergence, Improper Solutions, and Goodness-of-Fit Indices for Maximum Likelihood Confirmatory Factor AnalysisPsychometrika, 1984