An Improved YOLOv8 OBB Model for Ship Detection through Stable Diffusion Data Augmentation
Open Access
Abstract
Unmanned aerial vehicles (UAVs) with cameras offer extensive monitoring capabilities and exceptional maneuverability, making them ideal for real-time ship detection and effective ship management. However, ship detection by camera-equipped UAVs faces challenges when it comes to multi-viewpoints, multi-scales, environmental variability, and dataset scarcity. To overcome these challenges, we proposed a data augmentation method based on stable diffusion to generate new images for expanding the dataset. Additionally, we improve the YOLOv8n OBB model by incorporating the BiFPN structure and EMA module, enhancing its ability to detect multi-viewpoint and multi-scale ship instances. Through multiple comparative experiments, we evaluated the effectiveness of our proposed data augmentation method and the improved model. The results indicated that our proposed data augmentation method is effective for low-volume datasets with complex object features. The YOLOv8n-BiFPN-EMA OBB model we proposed performed well in detecting multi-viewpoint and multi-scale ship instances, achieving the mAP (@0.5) of 92.3%, the mAP (@0.5:0.95) of 77.5%, a reduction of 0.8 million in model parameters, and a detection speed that satisfies real-time ship detection requirements.Keywords
Funding Information
- 2023 Guangdong Province Graduate Education Innovation Program
This publication has 44 references indexed in Scilit:
- A stable diffusion enhanced YOLOV5 model for metal stamped part defect detection based on improved network structureJournal of Manufacturing Processes, 2024
- Marine vessel detection dataset and benchmark for unmanned surface vehiclesApplied Ocean Research, 2023
- Deep learning-based object detection in maritime unmanned aerial vehicle imagery: Review and experimental comparisonsEngineering Applications of Artificial Intelligence, 2023
- A feature enhanced RetinaNet-based for instance-level ship recognitionEngineering Applications of Artificial Intelligence, 2023
- Deep learning based efficient ship detection from drone-captured images for maritime surveillanceOcean Engineering, 2023
- Anomaly-GAN: A data augmentation method for train surface anomaly detectionExpert Systems with Applications, 2023
- Improving maritime traffic surveillance in inland waterways using the robust fusion of AIS and visual dataOcean Engineering, 2023
- Silicon energy bulk material cargo ship detection and tracking method combining YOLOv5 and DeepSortEnergy Reports, 2023
- Economic forces shaping the evolution of integrated port systems - The case of the container port system of China's Pearl River DeltaResearch in Transportation Economics, 2022
- Real-time georeferencing of thermal images using small fixed-wing UAVs in maritime environmentsISPRS Journal of Photogrammetry and Remote Sensing, 2019