Explainable AI Methods for Object Detection in Safety-CriticalApplications: A Systematic Review
Authors:
- Marianne KramerMKMarianne Kramer
- Roy LindelaufRLRoy Lindelauf
- Marie Safar-PostmaMSMarie Safar-Postma
- Job TimmermansJTJob Timmermans
Preprint
- 16 April 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Object detection is increasingly used in a variety of safety-critical settings, such as UAV (Unmanned Aerial Vehicle) search-and-rescue or pedestrian detection in autonomous driving. In such contexts, mis- or non-detected objects can have severe ethical consequences. However, the opaque nature of deep learning models complicates identification of risks, thereby undermining epistemic trust. Explainable AI (xAI) methods have been developed to make these models more human-understandable. This systematic review examines 75 studies presenting xAI methods designed for object detection, assessing both their methodological design and evaluation practices. While current methods offer valuable insights, several challenges hinder trustworthy implementation. Evaluation practices remain inconsistent, relying on fragmented metrics that complicate method comparison. Local explanations are most prominent, but are open to robustness and generalizability problems. Moreover, variation in datasets, model architectures, and evaluation practices introduces bias risk and reduces reproducibility. To advance the field, more standardized evaluation, increased robustness, and generalizable insights are needed, taking into account more complex and specific architectures. These advances will improve the validity and reliability of xAI methods and support trustworthy deployment of object detection in safety-critical contexts.Keywords
This publication has 77 references indexed in Scilit:
- Mapping the landscape of ethical considerations in explainable AI researchEthics and Information Technology, 2024
- Evaluating feature attribution methods in the image domainMachine Learning, 2024
- MANet: Mixed Attention Network for Visual ExplanationNew Generation Computing, 2024
- DExT: Detector Explanation Toolkit2023
- Evaluating the Stability of Semantic Concept Representations in CNNs for Robust Explainability2023
- Computer Vision Explainability for Object Detection in Safety Surveillance2023
- Connecting ethics and epistemology of AIAI & SOCIETY, 2023
- A comprehensive taxonomy for explainable artificial intelligence: a systematic survey of surveys on methods and conceptsData Mining and Knowledge Discovery, 2023
- The Pragmatic Turn in Explainable Artificial Intelligence (XAI)Minds and Machines, 2019
- Diagnosing Error in Object Detectors2012