Preliminary Multilevel Confirmatory Factor Analysis of the Startle and Surprise Inventories using Simulated Flight Scenarios
Open Access
- 29 November 2025
- journal article
- Published by SAGE Publications in Journal of Cognitive Engineering and Decision Making
- Vol. 20 (4) , 355-371
Abstract
This study was designed to validate the factor structure of the Startle and Surprise Inventories using multilevel confirmatory factor analysis in an ecologically valid flightdeck setting. The Startle and Surprise Inventories were developed to assess self-report startle and surprise to target stimuli. As their use expands in operational settings, construct validity should be further examined in contexts with ecological validity. 208 observations were collected from 26 professional pilots exposed to eight scenarios with varied levels of startle and surprise in a motion-based simulator. After each scenario, pilots completed the Startle and Surprise Inventories. A two-factor model, comprising the constructs Startle and Surprise, demonstrated superior and acceptable fit over a one-factor model. All items demonstrated significant factor loadings at both within- and between-scenario levels in the two-factor solution. McDonald’s ω ranged from ω = 0.88 to ω = 0.96 for the Startle Inventory, and ω = 0.77 to ω = 0.96 for the Surprise Inventory, indicating acceptable to excellent internal consistency. The findings offer empirical support for the construct validity and reliability of the Startle and Surprise Inventories in a highly ecologically-valid setting. The validated and reliable measures can inform evidence-based safety training protocols and interventions in aviation and other safety-critical domains.Keywords
This publication has 39 references indexed in Scilit:
- Startle and surprise in helicopter operations: reported prevalence and application of mitigation strategiesCognition, Technology & Work, 2025
- The Effect of Personality Traits and Flight Experience on Pilots’ Cognitive and Affective Responses to Simulated In-Flight HazardsAviation Psychology and Applied Human Factors, 2024
- Exaggerated startle reactionsClinical Neurophysiology, 2012
- Power and sensitivity of alternative fit indices in tests of measurement invariance.Journal of Applied Psychology, 2008
- A Scaled Difference Chi-Square Test Statistic for Moment Structure AnalysisPsychometrika, 2001
- The neurobiology of startleProgress in Neurobiology, 1999
- Toward a Process Analysis of Emotions: The Case of SurpriseMotivation and Emotion, 1997
- Stability of emotion experiences and their relations to traits of personality.Journal of Personality and Social Psychology, 1993
- Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.Psychological Bulletin, 1988
- Effects of startle due to pistol shots on control precision performanceJournal of Sound and Vibration, 1971