Explainable AI Methods for Object Detection in Safety-CriticalApplications: A Systematic Review

Authors:

Abstract
Object detection is increasingly used in a variety of safety-critical settings, such as UAV (Unmanned Aerial Vehicle) search-and-rescue or pedestrian detection in autonomous driving. In such contexts, mis- or non-detected objects can have severe ethical consequences. However, the opaque nature of deep learning models complicates identification of risks, thereby undermining epistemic trust. Explainable AI (xAI) methods have been developed to make these models more human-understandable. This systematic review examines 75 studies presenting xAI methods designed for object detection, assessing both their methodological design and evaluation practices. While current methods offer valuable insights, several challenges hinder trustworthy implementation. Evaluation practices remain inconsistent, relying on fragmented metrics that complicate method comparison. Local explanations are most prominent, but are open to robustness and generalizability problems. Moreover, variation in datasets, model architectures, and evaluation practices introduces bias risk and reduces reproducibility. To advance the field, more standardized evaluation, increased robustness, and generalizable insights are needed, taking into account more complex and specific architectures. These advances will improve the validity and reliability of xAI methods and support trustworthy deployment of object detection in safety-critical contexts.

This publication has 77 references indexed in Scilit: