Guess Where: The Position of Correct Answers in Multiple‐Choice Test Items as a Psychometric Variable
- 15 June 2003
- journal article
- Published by Wiley in Journal of Educational Measurement
- Vol. 40 (2) , 109-128
Abstract
In this article, the authors show that test makers and test takers have a strong and systematic tendency for hiding correct answers—or, respectively, for seeking them—in middle positions. In single, isolated questions, both prefer middle positions to extreme ones in a ratio of up to 3 or 4 to 1. Because test makers routinely, deliberately, and excessively balance the answer key of operational tests, middle bias almost, though not quite, disappears in those keys. Examinees taking real tests also produce answer sequences that are more balanced than their single question tendencies but less balanced than the correct key. In a typical four‐choice test, about 55% of erroneous answers are in the two central positions. The authors show that this bias is large enough to have real psychometric consequences, as questions with middle correct answers are easier and less discriminating than questions with extreme correct answers, a fact of which some implications are explored.Keywords
This publication has 19 references indexed in Scilit:
- Validity of a Taxonomy of Multiple-Choice Item-Writing RulesApplied Measurement in Education, 1989
- Positional response bias in multiple-choice tests of learning: Its relation to testwiseness and guessing strategy.Journal of Educational Psychology, 1987
- Response Biases in Multiple-Choice Test Item FilesEducational and Psychological Measurement, 1982
- The predominance of seven and the apparent spontaneity of numerical choices.Journal of Experimental Psychology: Human Perception and Performance, 1976
- The predominance of seven and the apparent spontaneity of numerical choices.Journal of Experimental Psychology: Human Perception and Performance, 1976
- The effect of correct response location on the difficulty level of multiple-choice questions.Journal of Applied Psychology, 1963
- Systematic Biases in the Keying of Correct Responses on Certain Standardized TestsEducational and Psychological Measurement, 1958
- General response patterns to five-choice items.Journal of Educational Psychology, 1956
- Response Sets in a Multiple-Choice TestEducational and Psychological Measurement, 1955
- The effect of choice placement on the difficulty of multiple-choice questions.Journal of Educational Psychology, 1945