Statistical modelling of networked human-automation performance using working memory capacity
- 5 December 2013
- journal article
- research article
- Published by Taylor & Francis in Ergonomics
- Vol. 57 (3) , 295-318
Abstract
This study examines the challenging problem of modelling the interaction between individual attentional limitations and decision-making performance in networked human-automation system tasks. Analysis of real experimental data from a task involving networked supervision of multiple unmanned aerial vehicles by human participants shows that both task load and network message quality affect performance, but that these effects are modulated by individual differences in working memory (WM) capacity. These insights were used to assess three statistical approaches for modelling and making predictions with real experimental networked supervisory performance data: classical linear regression, non-parametric Gaussian processes and probabilistic Bayesian networks. It is shown that each of these approaches can help designers of networked human-automated systems cope with various uncertainties in order to accommodate future users by linking expected operating conditions and performance from real experimental data to observable cognitive traits like WM capacity. Practitioner Summary: Working memory (WM) capacity helps account for inter-individual variability in operator performance in networked unmanned aerial vehicle supervisory tasks. This is useful for reliable performance prediction near experimental conditions via linear models; robust statistical prediction beyond experimental conditions via Gaussian process models and probabilistic inference about unknown task conditions/WM capacities via Bayesian network models.Keywords
This publication has 25 references indexed in Scilit:
- Adaptive Aiding of Human-Robot TeamingJournal of Cognitive Engineering and Decision Making, 2011
- Real-time performance modelling of a Sustained Attention to Response TaskErgonomics, 2010
- UAV-guided navigation for ground robot tele-operation in a military reconnaissance environmentErgonomics, 2010
- Learning HMM-based cognitive load models for supporting human-agent teamworkCognitive Systems Research, 2010
- Communication challenges in emergency responseCommunications of the ACM, 2007
- NETWORK PERFORMANCE IMPACTS ON OPERATORS IN SAFETY-CRITICAL SYSTEMSInternational Journal of Information Technology & Decision Making, 2006
- A Flexible Delegation-Type Interface Enhances System Performance in Human Supervision of Multiple Robots: Empirical Studies With RoboFlagIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2005
- User-Centered Evaluation of Multi-National Communication and Collaborative Technologies in a Network-Centric Air Battle Management EnvironmentProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2004
- A Tutorial on Learning with Bayesian Networks1998
- Humans and Automation: Use, Misuse, Disuse, AbuseHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1997