Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics
Open Access
- 16 January 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (2) , 766
Abstract
Technological advancements have facilitated the development of sophisticated vision systems, integrating optical sensors with artificial vision and machine learning techniques to create applications in different fields of robotics. One such field is Search and Rescue (SAR) robotics, which has historically played a significant role in assisting brigades following post-disaster events, particularly in exploration phases and, crucially, in victim identification. The importance of employing these systems in victim identification lies in their functionality under challenging conditions, enabling the capture of information across different light spectrum ranges (RGB, Thermal, Multispectral). This article proposes an innovative comparative analysis that scrutinizes the advantages and limitations of three sensor types in victim detection. It explores contemporary developments in the state-of-the-art and proposes new metrics addressing critical aspects, such as functionality in specific scenarios and the analysis of environmental disturbances. For the indoor and outdoor testing phase, a quadrupedal robot has been equipped with these cameras. The primary findings highlight the individual contributions of each sensor, particularly emphasizing the efficacy of the infrared spectrum for the thermal camera and the Near Infrared and Red Edge bands for the multispectral camera. Ultimately, following system evaluations, detection precisions exceeding 92% and 86%, respectively, were achieved.Keywords
Funding Information
- Proyectos de I+D+i del Ministerio de Ciencia, Innovacion y Universidades (PID2019-105808RB-I00, PID2022-142129OB-I00)
- Proyecto CollaborativE Search And Rescue robots 709 (CESAR) (PID2019-105808RB-I00, PID2022-142129OB-I00)
- MCIN/AEI/10.13039/501100011033 (PID2019-105808RB-I00, PID2022-142129OB-I00)
- ERDF A 710 way of making Europe (PID2019-105808RB-I00, PID2022-142129OB-I00)
This publication has 33 references indexed in Scilit:
- Locating victims in hot environments using combined thermal and optical imagingComputers and Electrical Engineering, 2020
- Real time object detection for aerial search and rescue missions for missing persons2020
- High Performance Vision Intelligence2020
- Victim Localization in USAR Scenario Exploiting Multi-Layer Mapping StructureRemote Sensing, 2019
- Unsupervised Human Detection with an Embedded Vision System on a Fully Autonomous UAV for Search and Rescue OperationsSensors, 2019
- Project Vulture: A Prototype for Using Drones in Search and Rescue Operations2019
- Detection of bodies in maritime rescue operations using unmanned aerial vehicles with multispectral camerasJournal of Field Robotics, 2018
- Simultaneous exploration and segmentation for search and rescueJournal of Field Robotics, 2018
- UAV-based multispectral remote sensing for precision agriculture: A comparison between different camerasISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Using Deep Learning and Low-Cost RGB and Thermal Cameras to Detect Pedestrians in Aerial Images Captured by Multirotor UAVSensors, 2018