Occluded Prohibited Items Detection: An X-ray Security Inspection Benchmark and De-occlusion Attention Module
Authors:
Open Access
- 12 October 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 138-146
Abstract
Security inspection often deals with a piece of baggage or suitcase where objects are heavily overlapped with each other, resulting in an unsatisfactory performance for prohibited items detection in X-ray images. In the literature, there have been rare studies and datasets touching this important topic. In this work, we contribute the first high-quality object detection dataset for security inspection, named Occluded Prohibited Items X-ray (OPIXray) image benchmark. OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport. The test set is further divided into three occlusion levels to better understand the performance of detectors. Furthermore, to deal with the occlusion in X-ray images detection, we propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors. Despite the heavy occlusion in X-ray imaging, shape appearance of objects can be preserved well, and meanwhile different materials visually appear with different colors and textures. Motivated by these observations, our DOAM simultaneously leverages the different appearance information of the prohibited item to generate the attention map, which helps refine feature maps for the general detectors. We comprehensively evaluate our module on the OPIXray dataset, and demonstrate that our module can consistently improve the performance of the state-of-the-art detection methods such as SSD, FCOS, etc, and significantly outperforms several widely-used attention mechanisms. In particular, the advantages of DOAM are more significant in the scenarios with higher levels of occlusion, which demonstrates its potential application in real-world inspections. The OPIXray benchmark and our model are released at https://github.com/OPIXray-author/OPIXray.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Occlusion-Aware R-CNN: Detecting Pedestrians in a Crowd2018
- Bi-box Regression for Pedestrian Detection and Occlusion Estimation2018
- Non-local Neural Networks2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning2017
- Detecting Masked Faces in the Wild with LLE-CNNs2017
- Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks2016
- SSD: Single Shot MultiBox Detector2016
- GDXray: The Database of X-ray Images for Nondestructive TestingJournal of Nondestructive Evaluation, 2015
- RGB-D Object Recognition via Incorporating Latent Data Structure and Prior KnowledgeIEEE Transactions on Multimedia, 2015