A Psychophysiological Model Based on Machine Learning Algorithms for Evaluating Commercial Airline Pilots' Mental Workload in Flight‐Simulation Context
- 17 June 2025
- journal article
- Published by Wiley in Human Factors and Ergonomics in Manufacturing & Service Industries
- Vol. 35 (4)
Abstract
Pilot errors account for the majority of flight accidents, many of which are influenced by mental workload. This study introduces a data‐driven psychophysiological model, utilizing machine learning algorithms, to evaluate pilots' mental workload. We conducted a flight‐simulation experiment involving twenty commercial airline pilots, assessing their mental workload under varying levels of task demand and visibility conditions. Psychophysiological responses were recorded, and machine learning algorithms were employed to analyze the data. To evaluate model performance, we used a leave‐one‐subject‐out cross‐validation method and calculated area under the curve values. Our findings indicate that psychophysiological metrics vary in their sensitivity to changes in pilots' mental workload. Notably, the Gradient Boosting Decision Tree algorithm demonstrated the highest classification performance under high‐visibility conditions, while the Gaussian Naive Bayes algorithm excelled under low‐visibility conditions. These results suggest pilots' mental workload can be effectively identified through psychophysiological metrics combined with machine learning algorithms. Furthermore, visibility conditions may influence the model's classification performance. This model offers a complementary approach to the subjective evaluation currently used by flight instructors to assess pilots' mental workload management capabilities during flight training and certification. It also provides a data‐driven tool aligned with evidence‐based training principles, enhancing the evaluation of pilots' mental workload management capabilities in flight scenarios.Keywords
This publication has 49 references indexed in Scilit:
- Recent Developments and Future Directions of Wearable Skin Biosignal SensorsAdvanced Sensor Research, 2023
- Towards safe and collaborative aerodrome operations: Assessing shared situational awareness for adverse weather detection with EEG-enabled Bayesian neural networksAdvanced Engineering Informatics, 2022
- Driving performance, sleepiness, fatigue, and mental workload throughout the time course of semi‐automated driving—Experimental data from the driving simulatorHuman Factors and Ergonomics in Manufacturing & Service Industries, 2020
- Assessment and monitoring of mental workload in subway train operations using physiological, subjective, and performance measuresHuman Factors and Ergonomics in Manufacturing & Service Industries, 2020
- Human performance assessment of a single air traffic controller conducting multiple remote tower operationsHuman Factors and Ergonomics in Manufacturing & Service Industries, 2019
- Understanding mental workload: from a clarifying concept analysis toward an implementable frameworkCognition, Technology & Work, 2018
- Electrodermal Activity2012
- AUC: A Better Measure than Accuracy in Comparing Learning Algorithms2003
- Wizard of Oz studies — why and howKnowledge-Based Systems, 1993
- The Concept and Measurement of Mental Effort1986