Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers
Authors:
Open Access
- 1 March 2016
- journal article
- research article
- Published by American Society for Cell Biology (ASCB) in CBE—Life Sciences Education
- Vol. 15 (1) , rm1
Abstract
Most discipline-based education researchers (DBERs) were formally trained in the methods of scientific disciplines such as biology, chemistry, and physics, rather than social science disciplines such as psychology and education. As a result, DBERs may have never taken specific courses in the social science research methodology—either quantitative or qualitative—on which their scholarship often relies so heavily. One particular aspect of (quantitative) social science research that differs markedly from disciplines such as biology and chemistry is the instrumentation used to quantify phenomena. In response, this Research Methods essay offers a contemporary social science perspective on test validity and the validation process. The instructional piece explores the concepts of test validity, the validation process, validity evidence, and key threats to validity. The essay also includes an in-depth example of a validity argument and validation approach for a test of student argument analysis. In addition to DBERs, this essay should benefit practitioners (e.g., lab directors, faculty members) in the development, evaluation, and/or selection of instruments for their work assessing students or evaluating pedagogical innovations.Keywords
This publication has 25 references indexed in Scilit:
- A Critical Analysis of Assessment Quality in Genomics and Bioinformatics Education ResearchCBE—Life Sciences Education, 2013
- Barriers to Faculty Pedagogical Change: Lack of Training, Time, Incentives, and…Tensions with Professional Identity?CBE—Life Sciences Education, 2012
- A Model for Using a Concept Inventory as a Tool for Students' Assessment and Faculty Professional DevelopmentCBE—Life Sciences Education, 2010
- The Genetics Concept Assessment: A New Concept Inventory for Gauging Student Understanding of GeneticsCBE—Life Sciences Education, 2008
- Development and evaluation of the conceptual inventory of natural selectionJournal of Research in Science Teaching, 2002
- Effects of Training and Supervision on the Self-Efficacy of Psychology Graduate Teaching AssistantsTeaching of Psychology, 1999
- Standards of Validity and the Validity of Standards in Performance AsessmentEducational Measurement: Issues and Practice, 1995
- The Interplay of Evidence and Consequences in the Validation of Performance AssessmentsEducational Researcher, 1994
- Complex, Performance-Based Assessment: Expectations and Validation CriteriaEducational Researcher, 1991
- Procedures for Assessing the Validities of Tests Using the "Known-Groups" MethodApplied Psychological Measurement, 1984