Very Short Answer Questions in Team-Based Learning: Limited Effect on Peer Elaboration and Memory
- 20 December 2022
- journal article
- research article
- Published by Springer Nature in Medical Science Educator
- Vol. 33 (1) , 139-145
Abstract
Introduction In team-based learning (TBL), single best answer questions (SBAQs) are traditionally used because immediate computer-assisted feedback facilitates team discussions. Recent improvements in digital marking systems and criticisms of non-analytical strategies in SBAQs have prompted the consideration of very short answer questions (VSAQs) as an alternative to SBAQs. We aim to compare the effect of VSAQs and SBAQs on peer elaboration and knowledge retention in TBL. Materials and Methods Twenty-four second-year students from the Lee Kong Chian School of Medicine participated in a mixed-methods study that included a randomised controlled crossover trial with two intervention arms (TBL-VSAQs and TBL-SBAQs). Two TBL sessions were conducted, with one topic covered each. Students were randomly allocated into six teams of four members. Individual and team scores and completion times were measured, and students were surveyed on their TBL experience. A follow-up quiz on the same topics was administered two weeks later to assess knowledge retention. Results Individuals scored lower for VSAQs than SBAQs in the second TBL topic (7.17 ± 1.52 versus 8.25 ± 1.48; p = 0.046), while findings in other metrics were non-significant. Follow-up quiz scores showed no significant difference in knowledge retention, although effect size and power were low. Students perceived VSAQs as more authentic and challenging, though most preferred the continued use of SBAQs for TBL. Discussion VSAQs have a limited impact on peer elaboration and knowledge retention versus SBAQs in TBL. Conclusions We should be circumspect about implementing VSAQs in TBL especially for medical students at the pre-clinical level.Keywords
Funding Information
- Nanyang Technological University (IRB-2020-01-029)
This publication has 14 references indexed in Scilit:
- A Psychological Foundation for Team-Based Learning: Knowledge ReconsolidationAcademic Medicine, 2019
- Comparing single-best-answer and very-short-answer questions for the assessment of applied medical knowledge in 20 UK medical schools: Cross-sectional studyBMJ Open, 2019
- Patients don’t come with multiple choice options: essay-based assessment in UMEMedical Education Online, 2019
- Implementation of team-based learning on a large scale: Three factors to keep in mind*Medical Teacher, 2018
- Very‐short‐answer questions: reliability, discrimination and acceptabilityMedical Education, 2018
- Validity of very short answer versus single best answer questions for undergraduate assessmentBMC Medical Education, 2016
- Bloom’s taxonomy of cognitive learning objectivesJournal of the Medical Library Association, 2015
- Multiple-Choice Tests Exonerated, at Least of Some ChargesPsychological Science, 2012
- On the Proper Use of the Crossover Design in Clinical TrialsDeutsches Ärzteblatt international, 2012
- Team-based learning: A practical guide: AMEE Guide No. 65Medical Teacher, 2012