Can We Trust Deep Learning Models in SAR ATR?
- 22 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Abstract
Deep learning has significantly enhanced the performance of automatic target recognition (ATR) in synthetic aperture radar (SAR). However, the concept of model overinterpretation, characterized by classifiers discerning strong class evidence within image regions that lack semantically salient features related to target (e.g., background clutter in SAR images), has undermined confidence in the reliability of deep learning models. Previous studies predominantly relied solely on one interpretability method to qualitatively identify the key input pixels, without assessing the efficiency of these features in decision-making process, posing a significant hurdle in evaluating the model overinterpretation. In this paper, we propose necessity-sufficiency index (NSI) to select models’ decision-making basis among all the key regions identified by multiple interpretability methods and segmentation algorithm. Furthermore, we propose weighted composition ratio statistic (WCRS) method to quantitatively analyze the model overinterpretation by incorporating the NSI as weighted average weights. The experimental results indicate that our methods are capable of accurately identifying the decision-making features and quantitatively analyzing the models’ tendency towards overinterpretation.Keywords
Funding Information
- National Natural Science Foundation of China (62071333)
This publication has 14 references indexed in Scilit:
- Self-Matching CAM: A Novel Accurate Visual Explanation of CNNs for SAR Image InterpretationRemote Sensing, 2021
- Automatic Target Recognition on Synthetic Aperture Radar Imagery: A SurveyIEEE Aerospace and Electronic Systems Magazine, 2021
- Explainability of Deep SAR ATR Through Feature AnalysisIEEE Transactions on Aerospace and Electronic Systems, 2020
- FEC: A Feature Fusion Framework for SAR Target Recognition Based on Electromagnetic Scattering Features and Deep CNN FeaturesIEEE Transactions on Geoscience and Remote Sensing, 2020
- Why general artificial intelligence will not be realizedHumanities and Social Sciences Communications, 2020
- Comparison of Descriptors for SAR ATR2019
- Evaluating the Visualization of What a Deep Neural Network Has LearnedIEEE Transactions on Neural Networks and Learning Systems, 2016
- Target Classification Using the Deep Convolutional Networks for SAR ImagesIEEE Transactions on Geoscience and Remote Sensing, 2016
- Convolutional neural networks for SAR image segmentation2015
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979