The concept of validity in theory and practice
Authors:
- 30 April 2010
- journal article
- research article
- Published by Taylor & Francis in Assessment in Education: Principles, Policy & Practice
- Vol. 17 (2) , 117-132
Abstract
The concept of validity, as described in the literature, has changed over time to become a broad and rather complex issue. The purpose of this paper is to investigate if practice has followed theory, or if there is a gap between validity in theory and validity in practice. It compares the theoretical development of the concept of validity with the methodology adopted in validity studies over time. Important phases in the history of validity, and also common arguments for and against traditional and modern validity perspectives, are presented and discussed. Thereafter, three Swedish research projects aiming to validate instruments used for selection to higher education are described. The idea is to use these projects as examples of contemporary practice, and to compare their designs, research questions and outcomes with how validity was theoretically described during their specific period of time. The conclusions from these comparisons are that practices seem to have followed theory when it comes to how the validity research programmes have been designed, but not when it comes to how they then were carried out in practice. This gap between theory and practice seems to have increased with the introduction of broader and more modern validity perspectives. The scope of the research is more extensive but results are fragmented and there is no evidence of a ‘unified’ validity argument, which has been one of the central aspects in modern validity theory. This supports the arguments that validity theory is difficult to put into practice and that there is a need for guidance on how to prioritise validity questions and interpret validity evidence.Keywords
This publication has 22 references indexed in Scilit:
- Different Grounds for Admission: Its effects on recruitment and achievement in medical educationScandinavian Journal of Educational Research, 2006
- Separating Quantitative and Analytic Dimensions in the Swedish Scholastic Aptitude Test (SweSAT)Scandinavian Journal of Educational Research, 2005
- Grade inflation and school competition: an empirical analysis based on the Swedish upper secondary schoolsEconomics of Education Review, 2005
- The Concept of Validity.Psychological Review, 2004
- Effects of Practice and Intellectual Growth on Performance on the Swedish Scholastic Aptitude Test (SweSAT)European Journal of Psychological Assessment, 2004
- Study SuccessScandinavian Journal of Educational Research, 2003
- Validity issues in higher education selection: A Swedish exampleStudies in Educational Evaluation, 1999
- An argument-based approach to validity.Psychological Bulletin, 1992
- Construct validity in psychological tests.Psychological Bulletin, 1955
- Technical recommendations for psychological tests and diagnostic techniques.Psychological Bulletin, 1954