Application of the Overclaiming Technique to Scholastic Assessment
Authors:
- 3 June 2014
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 74 (6) , 975-990
Abstract
The overclaiming technique is a novel assessment procedure that uses signal detection analysis to generate indices of knowledge accuracy (OC-accuracy) and self-enhancement (OC-bias). The technique has previously shown robustness over varied knowledge domains as well as low reactivity across administration contexts. Here we compared the OC-accuracy index with multiple choice (MC) and short answer (SA) tests in assessing knowledge of introductory psychology topics in a sample of 108 undergraduates. Results indicated that OC-accuracy was (a) comparable to MC and SA in predicting overall course grades and (b) superior to SA tests in reliability achieved per unit administration time. By including the OC-bias index, the overclaiming method also adds a unique element to scholastic testing, namely, a measure of knowledge self-enhancement. The latter index was a negative predictor of overall course grade, suggesting a narcissistic self-destructiveness. Because the self-enhancement index adds no extra administration time to the knowledge measure, the overclaiming approach provides a more rich and efficient information source compared with traditional methods of scholastic assessment.Keywords
This publication has 37 references indexed in Scilit:
- Scoring Yes–No vocabulary tests: Reaction time vs. nonword approachesLanguage Testing, 2012
- Overclaiming as a measure of fakingOrganizational Behavior and Human Decision Processes, 2011
- Optimal correction for guessing in multiple-choice testsJournal of Mathematical Psychology, 2010
- Know thyself: Misperceptions of actual performance undermine achievement motivation, future performance, and subjective well-being.Journal of Personality and Social Psychology, 2010
- Measuring cognitive ability with the overclaiming techniqueIntelligence, 2004
- Balancing the Need for Reliability and Time Efficiency: Short Forms of the Wechsler Adult Intelligence Scale-IIIEducational and Psychological Measurement, 2004
- Self-evaluation bias and academic performance: Some ways and some reasons whyJournal of Research in Personality, 2003
- Positive illusions about the self: Short-term benefits and long-term costs.Journal of Personality and Social Psychology, 2001
- The Effectiveness of Several Multiple-Choice FormatsApplied Measurement in Education, 1992
- Validity and Reliability Consequences of Confidence WeightingEducational and Psychological Measurement, 1973