Augmented Reality Interface for Adverse-Visibility Conditions Validated by First Responders in Rescue Training Scenarios
Open Access
- 20 September 2024
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 13 (18) , 3739
Abstract
Updating the equipment of the first responder (FR) by providing them with new capabilities and useful information will inevitably lead to better mission success rates and, therefore, more lives saved. This paper describes the design and implementation of a modular interface for augmented reality displays integrated into standard FR equipment that will provide support during the adverse-visibility situations that the rescuers find during their missions. This interface includes assistance based on the machine learning module denoted as Robust Vision Module, which detects relevant objects in a rescue scenario, particularly victims, using the feed from a thermal camera. This feed can be displayed directly alongside the detected objects, helping FRs to avoid missing anything during their operations. Additionally, the information exposition in the interface is organized according to the biometrical parameters of FRs during the operations. The main novelty of the project is its orientation towards useful solutions for FRs focusing on something occasionally ignored during research projects: the point of view of the final user. The functionalities have been designed after multiple iterations between researchers and FRs, involving testing and evaluation through realistic situations in training scenarios. Thanks to this feedback, the overall satisfaction according to the evaluations of 18 FRs is 3.84 out of 5 for the Robust Vision Module and 3.99 out of 5 for the complete AR interface. These functionalities and the different display modes available for the FRs to adapt to each situation are detailed in this paper.Keywords
Funding Information
- European Union’s Horizon 2020 Research and Innovation Programme (101021836)
This publication has 25 references indexed in Scilit:
- Infrastructure-Less Prioritized Communication Platform for First RespondersIT Professional, 2023
- Smart Helmet: Combining Sensors, AI, Augmented Reality, and Personal Protection to Enhance First Responders’ Situational AwarenessIT Professional, 2023
- Cross-Device Augmented Reality Systems for Fire and Rescue based on Thermal Imaging and Live Tracking2023
- User-Centered Requirements for Augmented Reality as a Cognitive Assistant for Safety-Critical ServicesBusiness & Information Systems Engineering, 2022
- An embedded deep learning system for augmented reality in firefighting applications2020
- Real-time triggering reveals concurrent lapses of attention and working memoryNature Human Behaviour, 2019
- Cardiac Measures of Cognitive Workload: A Meta-AnalysisHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2019
- Cognitive Architecture and Instructional Design: 20 Years LaterEducational Psychology Review, 2019
- Respiratory Changes in Response to Cognitive Load: A Systematic ReviewNeural Plasticity, 2016
- Poly (ethylene terephthalate) recycling for high value added textilesFashion and Textiles, 2014