Multiple–True–False Questions Reveal the Limits of the Multiple–Choice Format for Detecting Students with Incomplete Understandings
- 16 May 2018
- journal article
- research article
- Published by Oxford University Press (OUP) in BioScience
- Vol. 68 (6) , 455-463
Abstract
By having students select one answer among several plausible options, multiple–choice (MC) questions capture a student's preferred answer but provide little information regarding a student's thinking on the remaining options. We conducted a crossover design experiment in which similar groups of introductory biology students were assigned verbatim questions in the MC format or multiple–true–false (MTF) format, which requires students to separately evaluate each option as either true or false. Our data reveal that nearly half of the students who select the correct MC answer likely hold incorrect understandings of the other options and that the selection rates for individual MC options provide inaccurate estimations of how many students separately endorse each option. These results suggest that MC questions systematically overestimate question mastery and underestimate the prevalence of mixed and partial conceptions, whereas MTF questions enable students and instructors to gain a more nuanced portrait of student thinking with little additional effort.Keywords
This publication has 26 references indexed in Scilit:
- Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science ClassesCBE—Life Sciences Education, 2012
- Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question ClustersCBE—Life Sciences Education, 2012
- Clickers in the Large Classroom: Current Research and Best-Practice TipsCBE—Life Sciences Education, 2007
- Multiple-Mark Items: An Alternative Objective Item Format?Educational and Psychological Measurement, 1997
- Success in college for students with discrepancies between performance on multiple-choice and essay tests.Journal of Educational Psychology, 1996
- A Brief Report on a Comparison of Six Scoring Methods for Multiple True-False ItemsEducational and Psychological Measurement, 1993
- The multiple choice true/false question: what does it measure and what could it measure?Medical Teacher, 1992
- Effectiveness of Multiple True-False ItemsApplied Measurement in Education, 1989
- Scoring Multiple True/False TestsEvaluation & the Health Professions, 1982
- THE RELATIVE MERITS OF MULTIPLE TRUE‐FALSE ACHIEVEMENT TESTSJournal of Educational Measurement, 1982