A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking
Preprint
Abstract
Deep neural networks (DNNs) have found widespread applications in interpreting remote sensing (RS) imagery. However, it has been demonstrated in previous works that DNNs are vulnerable to different types of noises, particularly adversarial noises. Surprisingly, there has been a lack of comprehensive studies on the robustness of RS tasks, prompting us to undertake a thorough survey and benchmark on the robustness of image classification and object detection in RS. To our best knowledge, this study represents the first comprehensive examination of both natural robustness and adversarial robustness in RS tasks. Specifically, we have curated and made publicly available datasets that contain natural and adversarial noises. These datasets serve as valuable resources for evaluating the robustness of DNNs-based models. To provide a comprehensive assessment of model robustness, we conducted meticulous experiments with numerous different classifiers and detectors, encompassing a wide range of mainstream methods. Through rigorous evaluation, we have uncovered insightful and intriguing findings, which shed light on the relationship between adversarial noise crafting and model training, yielding a deeper understanding of the susceptibility and limitations of various models, and providing guidance for the development of more resilient and robust modelsKeywords
All Related Versions
This publication has 95 references indexed in Scilit:
- A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and RethinkingInternational Journal of Computer Vision, 2024
- Adversarial patch attacks against aerial imagery object detectorsNeurocomputing, 2023
- Improving the invisibility of adversarial examples with perceptually adaptive perturbationInformation Sciences, 2023
- U-Turn: Crafting Adversarial Queries with Opposite-Direction FeaturesInternational Journal of Computer Vision, 2022
- Adversarial examples based on object detection tasks: A surveyNeurocomputing, 2022
- Enhancing real-world adversarial patches through 3D modeling of complex target scenesNeurocomputing, 2022
- Sparse Black-Box Video Attack with Reinforcement LearningInternational Journal of Computer Vision, 2022
- Understanding adversarial attacks on deep learning based medical image analysis systemsPattern Recognition, 2021
- A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretabilityComputer Science Review, 2020
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020