The effect on reliability of adding a separate written assessment component to an objective structured clinical examination
Authors:
- 1 July 2000
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 34 (7) , 525-529
Abstract
Purpose: To determine the effect on test reliability when a separate written assessment component is added to an objective structured clinical examination (OSCE). Method: Volunteers ( n =38) from Maastricht Medical School were recruited to take a skills‐related knowledge test in addition to their regular end‐of‐year OSCE. The OSCE scores of these volunteers did not differ from those of the other students of their class. Multivariate generalizability theory was used to investigate the combined reliability of the two test formats as well as their respective contributions to overall reliability. Results: Combining the two formats has an added value. The loss of reliability due to the use of fewer stations in the OSCE can be fully compensated by lengthening the written test component. Conclusion: From the perspective of test reliability, it is possible to economize on the resources needed for performance‐based assessment by adding a separate written test component.Keywords
This publication has 9 references indexed in Scilit:
- The assessment of professional competence: Developments, research and practical implicationsAdvances in Health Sciences Education, 1996
- Use of Standardized Patients in Clinical Assessments: Recent Developments and Measurement FindingsEducational Researcher, 1994
- Assessment of clinical skills with standardized patients: State of the artTeaching and Learning in Medicine, 1990
- A written test as an alternative to performance testingMedical Education, 1989
- Factors influencing reproducibility of tests using standardized patientsTeaching and Learning in Medicine, 1989
- Psychometric characteristics of the objective structured clinical examinationMedical Education, 1988
- Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competenceMedical Education, 1985
- The effect of assessments and examinations on the learning of medical studentsMedical Education, 1983
- Assessment of clinical competence using an objective structured clinical examination (OSCE)Medical Education, 1979