Observational assessment of situation awareness, team differences and training implications
Authors:
- 15 March 2006
- journal article
- research article
- Published by Taylor & Francis in Ergonomics
- Vol. 49 (4) , 393-417
Abstract
The two goals were to investigate, first, the practicability and reliability of observational assessment of team situation awareness (SA) and, second, the nature of any team differences, their consistency and training implications. Five shift teams tackled three scenarios, each with three probe events concerning SA, and three observers viewed and rated concurrently each shift. This methodology was found to be practicable and achieved satisfactory rater reliability as indicated by intraclass and inter-rater correlations. Team differences in SA emerged although there was no consistent pattern. A retrospective analysis of individual and team behaviours relating to SA was performed using the Critical Incident Technique. A total of 75 incidents and 20 behavioural dimensions relevant to SA were identified and these were subsumed under planning, problem solving, team coordination, attention, communication and knowledge. These findings are discussed with regard to the nature and measurement of SA, and the content of training to improve SA for control room teams.Keywords
This publication has 29 references indexed in Scilit:
- Training to break the barriers of habit in reasoning about unusual faults.Journal of Experimental Psychology: Applied, 1999
- Situation awareness during driving: Explicit and implicit knowledge in dynamic spatial memory.Journal of Experimental Psychology: Applied, 1997
- Forming inferences about some intraclass correlation coefficients.Psychological Methods, 1996
- Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plant control roomsErgonomics, 1995
- Situation Awareness and the Cognitive Management of Complex SystemsHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1995
- Situation Awareness in AnesthesiologyHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1995
- Situation Awareness: Proceed with CautionHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1995
- Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots' Model and Awareness of the Flight Management SystemThe International Journal of Aviation Psychology, 1994
- A Survey of Situation Awareness Requirements in Air-to-Air Combat FightersThe International Journal of Aviation Psychology, 1993
- Intraclass correlations: There's more there than meets the eye.Psychological Bulletin, 1983