Computer-based testing of the modified essay question: the Singapore experience
Open Access
- 1 January 2007
- journal article
- research article
- Published by Taylor & Francis in Medical Teacher
- Vol. 29 (9-10) , e261-e268
Abstract
Background: The modified essay question (MEQ), featuring an evolving case scenario, tests a candidate's problem-solving and reasoning ability, rather than mere factual recall. Although it is traditionally conducted as a pen-and-paper examination, our university has run the MEQ using computer-based testing (CBT) since 2003. Aims: We describe our experience with running the MEQ examination using the IVLE, or integrated virtual learning environment (https://ivle.nus.edu.sg), provide a blueprint for universities intending to conduct computer-based testing of the MEQ, and detail how our MEQ examination has evolved since its inception. Methods: An MEQ committee, comprising specialists in key disciplines from the departments of Medicine and Paediatrics, was formed. We utilized the IVLE, developed for our university in 1998, as the online platform on which we ran the MEQ. We calculated the number of man-hours (academic and support staff) required to run the MEQ examination, using either a computer-based or pen-and-paper format. Results: With the support of our university's information technology (IT) specialists, we have successfully run the MEQ examination online, twice a year, since 2003. Initially, we conducted the examination with short-answer questions only, but have since expanded the MEQ examination to include multiple-choice and extended matching questions. A total of 1268 man-hours was spent in preparing for, and running, the MEQ examination using CBT, compared to 236.5 man-hours to run it using a pen-and-paper format. Despite being more labour-intensive, our students and staff prefer CBT to the pen-and-paper format. Conclusions: The MEQ can be conducted using a computer-based testing scenario, which offers several advantages over a pen-and-paper format. We hope to increase the number of questions and incorporate audio and video files, featuring clinical vignettes, to the MEQ examination in the near future.Keywords
This publication has 18 references indexed in Scilit:
- Simulations in the United States Medical Licensing ExaminationTM (USMLETM)Quality and Safety in Health Care, 2004
- Computerized Versus Paper-and-Pencil Testing Methods for a Nursing Certification ExaminationCIN: Computers, Informatics, Nursing, 2004
- Results of the Scoliosis Research Society Instrument for Evaluation of Surgical Outcome in Adolescent Idiopathic ScoliosisSpine, 1999
- What is.… a Modified Essay Question?Medical Teacher, 1989
- The modified essay question: an evaluation of its use in a family medicine clerkshipMedical Education, 1987
- Modified Essay Questions: are they worth the effort?Medical Education, 1986
- A modified essay question evaluation of pre‐clinical teaching of communication skillsMedical Education, 1984
- The cognitive structure of the modified essay questionMedical Education, 1982
- The validity and reliability of a new examination of the clinical competence of medical studentsMedical Education, 1981
- A comparison of multiple‐choice tests and free‐response tests in examinations of clinical competenceMedical Education, 1979