Testing that Makes You Think: Development of a Basic Science Test to Promote Future Clinical Learning
Open Access
- 17 March 2026
- journal article
- research article
- Published by Springer Nature in Medical Science Educator
- Vol. 36 (3) , 1195-1212
Abstract
Introduction: Testing prior knowledge has been found to enhance learning new, related information. In this paper, we report on the development of a multiple-choice question (MCQ) test of basic science knowledge designed to elicit a particular kind of cognitive processing—distinctive processing—that, we argue, may be beneficial to future learning and clinical reasoning. Distinctive processing entails noticing both similarities and differences among concepts or entities. The recruitment and distinctive processing of prior basic science knowledge may optimally prepare learners to understand, remember and apply new, related clinical information. Methods: We developed two versions of a 19-item basic science MCQ. Both versions of the test had identical stems and correct response options; one version had very similar, plausible or “competitive” incorrect response options while the other version had less similar or “non-competitive” incorrect response options. We hypothesized that the “competitive” test version would elicit more distinctive processing than the “non-competitive” version. We conducted a concurrent verbal protocol to assess the response processes elicited by the two different test versions. Results: We found that the MCQ items designed with competitive or plausible incorrect answer options elicited more distinctive processing than MCQ items with less competitive or less plausible incorrect response options. Discussion: We showed that tests can be designed to promote cognitive processes that may be beneficial for future learning and that concurrent verbal protocols can be used to collect response process validity evidence for formative tests.Keywords
Funding Information
- Temerty Faculty of Medicine, University of Toronto
This publication has 45 references indexed in Scilit:
- Can all roads lead to competency? School levels effects in Licensing examinations scoresAdvances in Health Sciences Education, 2024
- From admissions to licensure: education data associations from a multi-centre undergraduate medical education collaborationAdvances in Health Sciences Education, 2024
- Emerging and Future Directions in Test-Enhanced Learning ResearchEducational Psychology Review, 2024
- Prequestioning and Pretesting Effects: a Review of Empirical Research, Theoretical Perspectives, and Implications for Educational PracticeEducational Psychology Review, 2023
- Effortful Tests and Repeated Metacognitive Judgments Enhance Future LearningEducational Psychology Review, 2023
- The Future of Biomedical and Life Science Education: Evidence-Based Future Directions2022
- Beyond right or wrong: More effective feedback for formative multiple-choice testsPerspectives on Medical Education, 2020
- A think-aloud study to inform the design of radiograph interpretation practiceAdvances in Health Sciences Education, 2020
- Response Processes in the Context of Validity: Setting the Stage2017
- The benefits of testing for learning on later performanceAdvances in Health Sciences Education, 2014