Pilots' Monitoring Strategies and Performance on Automated Flight Decks: An Empirical Study Combining Behavioral and Eye-Tracking Data
Open Access
- 1 June 2007
- journal article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 49 (3) , 347-357
Abstract
Objective: The objective of the study was to examine pilots' automation monitoring strategies and performance on highly automated commercial flight decks. Background: A considerable body of research and operational experience has documented breakdowns in pilot-automation coordination on modern flight decks. These breakdowns are often considered symptoms of monitoring failures even though, to date, only limited and mostly anecdotal data exist concerning pilots' monitoring strategies and performance. Method: Twenty experienced B-747-400 airline pilots flew a 1-hr scenario involving challenging automation-related events on a full-mission simulator. Behavioral, mental model, and eye-tracking data were collected. Results: The findings from this study confirm that pilots monitor basic flight parameters to a much greater extent than visual indications of the automation configuration. More specifically, they frequently fail to verify manual mode selections or notice automatic mode changes. In other cases, they do not process mode annunciations in sufficient depth to understand their implications for aircraft behavior. Low system observability and gaps in pilots' understanding of complex automation modes were shown to contribute to these problems. Conclusion: Our findings describe and explain shortcomings in pilot's automation monitoring strategies and performance based on converging behavioral, eye-tracking, and mental model data. They confirm that monitoring failures are one major contributor to breakdowns in pilot-automation interaction. Application: The findings from this research can inform the design of improved training programs and automation interfaces that support more effective system monitoring.Keywords
This publication has 13 references indexed in Scilit:
- Why Pilots Miss the Green Box: How Display Context Undermines Attention CaptureThe International Journal of Aviation Psychology, 2004
- Attentional Models of Multitask Pilot Performance Using Advanced Display TechnologyHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2003
- Effects of Data-Link Modality and Display Redundancy on Pilot Performance: An Attentional PerspectiveThe International Journal of Aviation Psychology, 2003
- The Need for Multisensory Interfaces in Support of Effective Attention Allocation in Highly Dynamic Event-Driven Domains: The Case of Cockpit AutomationThe International Journal of Aviation Psychology, 2000
- Shared Models of Flight Management System Vertical GuidanceThe International Journal of Aviation Psychology, 1999
- The VNAV Tutor: addressing a mode awareness difficulty for pilots of glass cockpit aircraftIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 1997
- How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory ControlHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1995
- Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots' Model and Awareness of the Flight Management SystemThe International Journal of Aviation Psychology, 1994
- Pilot Interaction With Cockpit Automation: Operational Experiences With the Flight Management SystemThe International Journal of Aviation Psychology, 1992
- What Do Pilots See in Displays?Proceedings of the Human Factors Society Annual Meeting, 1980