Avoiding Misconception, Misuse, and Missed Opportunities: The Collection of Verbal Reports in Educational Achievement Testing
- 1 December 2004
- journal article
- Published by Wiley in Educational Measurement: Issues and Practice
- Vol. 23 (4) , 6-15
Abstract
The collection of verbal reports is one way in which cognitive and developmental psychologists gather data to formulate and corroborate models of problem solving. The current use of verbal reports to design and validate educational assessments reflects the growing trend to fuse cognitive psychological research and educational measurement. However, doubts about the trustworthiness or accuracy of verbal reports may suggest a potential reversal of this trend. Misconceptions about the trustworthiness of verbal reports could signal misuse of verbal reports and, consequently, waning interest and missed opportunities in the description of cognitive models of test performance. In this article, misconceptions of verbal reports are addressed by (a) discussing the value of cognitive models for educational achievement testing; (b) addressing pertinent issues in the collection of verbal reports from students; and (c) concluding with avenues for a more productive union between cognitive psychological research and educational measurement.Keywords
This publication has 40 references indexed in Scilit:
- Accessing problem-solving strategy knowledge: The complementary use of concurrent verbal protocols and retrospective debriefing.Journal of Educational Psychology, 2000
- Chapter 9 : Addressing the “Two Disciplines” Problem: Linking Theories of Cognition and Learning With Assessment and Instructional PracticeReview of Research in Education, 1999
- Addressing the "Two Disciplines" Problem: Linking Theories of Cognition and Learning with Assessment and Instructional PracticeReview of Research in Education, 1999
- Investigating the Cognitive Complexity of Science AssessmentsEducational Measurement: Issues and Practice, 1998
- Comparing Cognitive Representations of Test Developers and Students on a Mathematics Test With Bloom's TaxonomyThe Journal of Educational Research, 1997
- Interview Procedures for Validating Science AssessmentsApplied Measurement in Education, 1997
- Test Theory ReconceivedJournal of Educational Measurement, 1996
- Cognitive Variability: A Key to Understanding Cognitive DevelopmentCurrent Directions in Psychological Science, 1994
- The validity of verbal protocolsMemory & Cognition, 1989
- Construct validity in psychological tests.Psychological Bulletin, 1955