Measuring the Unseen: A Situational Awareness Scoring Framework for Cyber Range Training
Preprint
- 19 November 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
As cyber-attacks grow in scale, sophistication, and impact, advanced training and evaluation platforms are essential for cybersecurity readiness. Cyber Ranges (CRs) provide controlled, high-fidelity simulation environments in which professionals can practice defensive strategies under realistic threat scenarios. In such environments, success depends not only on technical skill but also on robust Situational Awareness (SA), the cognitive capacity to perceive events, understand their meaning, and project future developments. Although SA is recognised as critical, existing CR evaluation methods typically focus on overall performance metrics (e.g., task completion rates, response accuracy, mission success). Such assessments often fail to capture the deeper, cognitive aspects of SA, limiting the CR’s ability to evaluate decision-making agility and strategic insight.In response, this paper presents the Situational Awareness Scoring System (SASS), a dynamic, multi-dimensional framework designed to quantify SA in live CR environments. SASS decomposes SA into core dimensions, perception, comprehension, projection, and resolution, then monitors trainee behaviour and scenario interactions in real time. Each dimension is assessed via weighted metrics: timing of responses, sequence and number of reasoning steps, usage and effectiveness of tools and techniques, hints requested, and decision outcomes. These metrics are aggregated into interpretable scores that reflect both aspects, specific performance and overall SA proficiency. In this study, we validate SASS in a series of cyber-defence exercises involving participants of differing expertise levels. Our results demonstrate that SASS scores correlate strongly with expert evaluations and can discriminate between high and low SA performers with high fidelity. SASS enables instructors to pinpoint cognitive weak spots (e.g. delayed perception or faulty projection) and adapt training on the fly. Ultimately, integrating SASS into CR platforms enriches the evaluation process, promoting not just technical competence but also the situational agility needed to counter modern cyber threats.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Enhanced (cyber) situational awareness: Using interpretable principal component analysis (iPCA) to automate vulnerability severity scoringDecision Support Systems, 2024
- Empirical Study on Cyber Range Capabilities, Interactions and Learning Features2021
- Adaptation and Validation of the Situation Awareness Global Assessment Technique for Nurse Anesthesia Graduate StudentsClinical Simulation in Nursing, 2020
- A Framework for the Evaluation of Trainee Performance in Cyber Range ExercisesMobile Networks and Applications, 2019
- A digital twin for rapid qualification of 3D printed metallic componentsApplied Materials Today, 2019
- Survey of Attack Projection, Prediction, and Forecasting in Cyber SecurityIEEE Communications Surveys & Tutorials, 2018
- Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree ComparisonIEEE Access, 2018
- Digital Twin in manufacturing: A categorical literature review and classificationIFAC-PapersOnLine, 2018
- Cyber situational awareness – A systematic review of the literatureComputers & Security, 2014
- Cyber Situational Awareness2010