‘Team observation’: a six-year study of the development and use of multi-source feedback (360-degree assessment) in obstetrics and gynaecology training in the UK
Open Access
- 1 January 2006
- journal article
- research article
- Published by Taylor & Francis in Medical Teacher
- Vol. 28 (7) , e177-e184
Abstract
Multi-source feedback, or 360-degree assessment, is an important part of the assessment of people in the workplace, in both health and industry. Almost all published work concentrates on content validity and generalizability. However, an assessment system needs construct validity, and has to have practicability and acceptability, without sacrificing fitness for purpose, content validity or inter-rater reliability. This was a six-year study of the first UK-wide hospital-based multi-source feedback system, in the specialty of obstetrics and gynaecology. This paper describes the development of the assessment tool, its use and the analyses of the results in several areas. These are picking up poor performance, congratulating good behaviour, construct validity, the number of domains to be measured, and the minimum number of raters. The study demonstrated that the Team Observation system in reality only measured a very limited number of attributes, and that the main construct under scrutiny is interpersonal behaviour. The system can identify those who may have a problem, using less than 10 raters, and yet the process can be a positive experience for the large majority of people who have been assessed.Keywords
This publication has 14 references indexed in Scilit:
- Development and reliability testing of TAB a form for 360° assessment of Senior House Officers’ professional behaviour, as specified by the General Medical CouncilMedical Teacher, 2005
- Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physiciansAcademic Medicine, 1996
- Professional behaviour of medical school graduates: an analysisMedical Education, 1994
- Resident-patient interactionsAcademic Medicine, 1994
- Ratings of the performances of practicing internists by hospital-based registered nursesAcademic Medicine, 1993
- Doctor-patient communication: the Toronto consensus statement.BMJ, 1991
- Nurses in Resident EvaluationEvaluation & the Health Professions, 1990
- Dimensionality, internal consistency and interrater reliability of clinical performance ratingsMedical Education, 1987
- Psychometric Properties of Clinical Performance RatingsEvaluation & the Health Professions, 1980
- Performance rating scale for peer and self assessment 1Medical Education, 1975