Test Design with Cognition in Mind
- 1 December 2006
- journal article
- Published by Wiley in Educational Measurement: Issues and Practice
- Vol. 25 (4) , 21-35
Abstract
One of the primary themes of the National Research Council's 2001 book Knowing What Students Know was the importance of cognition as a component of assessment design and measurement theory (NRC, 2001). One reaction to the book has been an increased use of sophisticated statistical methods to model cognitive information available in test data. However, the application of these cognitive‐psychometric methods is fruitless if the tests to which they are applied lack a formal cognitive structure. If assessments are to provide meaningful information about student ability, then cognition must be incorporated into the test development process much earlier than in data analysis. This paper reviews recent advancements in cognitively‐based test development and validation, and suggests various ways practitioners can incorporate similar methods into their own work.Keywords
This publication has 47 references indexed in Scilit:
- Diagnostic Assessment With Ordered Multiple-Choice ItemsEducational Assessment, 2006
- Introduction to Evidence Centered Design and Lessons Learned From Its Application in a Global E-Learning ProgramInternational Journal of Testing, 2004
- Are We Asking the Right Questions? Using Cognitive Interviews to Improve Surveys in Education ResearchEducational Evaluation and Policy Analysis, 2004
- A FEASIBILITY STUDY OF ON‐THE‐FLY ITEM GENERATION IN ADAPTIVE TESTINGETS Research Report Series, 2002
- Using New Technology to Improve AssessmentEducational Measurement: Issues and Practice, 1999
- Validity and Automad Scoring: It's Not Only the ScoringEducational Measurement: Issues and Practice, 1998
- Application of the rule-space procedure to language testing: examining attributes of a free response listening testLanguage Testing, 1998
- The Subskills of Reading: Rule‐space Analysis of a Multiple‐choice Test of Second Language Reading ComprehensionLanguage Learning, 1997
- Varieties of knowledge elicitation techniquesInternational Journal of Human-Computer Studies, 1994
- Applications of Cognitive Design Systems to Test Development1994