Human Detection from Drone using You Only Look Once (YOLOv5) for Search and Rescue Operation
Open Access
- 15 May 2023
- journal article
- research article
- Published by Akademia Baru Publishing in Journal of Advanced Research in Applied Sciences and Engineering Technology
- Vol. 30 (3) , 222-235
Abstract
Drones are unmanned aerial vehicles that can be remotely operated to perform a variety of tasks. They have been used in search and rescue operations since the early 2000s and have proven to be invaluable tools for quickly locating missing persons in difficult terrain and environment. In certain cases, automated human detection on drone camera feed can help the responder to locate the victims more effectively. In this work, we propose the use of a deep learning method called You Only Look Once version 5, or YOLOv5. The YOLOv5 model is trained using data collected during a simulation of search and rescue operations, where mannequins were used to represent human victims. Video was acquired using DJI Matrice 300 drone with Zenmuse H20T camera which flew around an area with various terrains such as farms, ravines, and river of more than 15,000 m2, at a height of 40 meters. The drone used grid, circular and zigzag flying patterns, with three different levels of camera zooms, and the data was captured on different days and times. The total duration of the video collected at 1080p@30fps is 148 minutes 26 seconds. Five pretrained models of YOLOv5 with different complexities were trained and tested using this dataset. Results showed that pretrained yolov5l6 model delivered the best precision, recall and mAP50 rate at 0.668, 0.303 and 0.346 respectively. Besides, the experiment also showed that we can improve the overall performance by using images acquired at 6x zoom magnification level where precision, recall, and mAP50 rate are increased to 0.846, 0.543, and 0.591 respectively. yolov5l6 model also delivered an acceptable inference time of 43ms per 1920x1080 resolution image, thus it can run at a respectable 23fps.Keywords
This publication has 22 references indexed in Scilit:
- Applications of drone in disaster management: A scoping reviewScience & Justice, 2022
- Toward AI-Assisted UAV for Human Detection in Search and Rescue Missions2021
- Drone-surveillance for search and rescue in natural disasterComputer Communications, 2020
- YOLO9000: Better, Faster, Stronger2017
- Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors2017
- Survey on Computer Vision for UAVs: Current Developments and TrendsJournal of Intelligent & Robotic Systems, 2017
- Drone-Assisted Disaster Management: Finding Victims via Infrared Camera and Lidar Sensor Fusion2016
- Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009