Multiple Objective Measures of Skill (MOMS)
Authors:
- Sean MackaySMSean Mackay
- Vivek DattaVDVivek Datta
- Avril ChangACAvril Chang
- Jyoti ShahJSJyoti Shah
- Roger KneeboneRKRoger Kneebone
- Ara DarziADAra Darzi
- 1 August 2003
- journal article
- research article
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 238 (2) , 291-300
Abstract
The assessment of surgical technical skills has become an important topic in recent years. This study presents the validation of a 6-task skills examination for junior surgical trainees (at the level of the Membership of the Royal College of Surgeons). Six tasks were evaluated in a project that also examined the feasibility of this method of assessment. The tasks were knowledge of sutures and instruments; knowledge of surgical devices; knot formation; skin-pad suturing, closure of an enterotomy; excision of a skin lesion; and laparoscopic manipulation. Comparisons were made between a group of junior trainees (n = 13), and a group of seniors (n = 8). Each of the 6 tasks was able to be used to discriminate between the 2 groups. In all, there were 19 primary analyses across the 6 tasks, and 17 of these showed significant differences between the groups (P values ranging from 0.037 to < 0.001). There was generally a strong correlation between the analyses, and when a mean rank was calculated, the difference between groups was significant (P = 0.005 on Mann-Whitney U test; mean ranks 13.9 and 6.3 [of 21], for juniors and seniors respectively). Reliability of the 6-task assessment was very good at 0.70 (Cronbach's Alpha). A skills examination is a feasible and effective method of assessing the technical ability of basic surgical trainees.Keywords
This publication has 24 references indexed in Scilit:
- The Use of Electromagnetic Motion Tracking Analysis To Objectively Measure Open Surgical Skill in The Laboratory-Based ModelJournal of the American College of Surgeons, 2001
- Validity of surgical simulation for the assessment of operative skillBritish Journal of Surgery, 2001
- Motion Analysis in the Assessment of Surgical SkillComputer Methods in Biomechanics and Biomedical Engineering, 2001
- Virtual Reality Training in Laparoscopic Surgery: A Preliminary Assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR)Endoscopy, 1999
- Testing technical skill via an innovative “bench station” examinationThe American Journal of Surgery, 1997
- Objective structured assessment of technical skill (OSATS) for surgical residentsBritish Journal of Surgery, 1997
- Objective structured assessment of technical skill (OSATS) for surgical residentsBritish Journal of Surgery, 1997
- Validation of an objective structured assessment of technical skill for surgical residentsAcademic Medicine, 1996
- Examining the educated and the trainedThe Lancet, 1995
- Teaching and testing technical skillsThe American Journal of Surgery, 1993