Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition
Authors:
- Taimur HassanTaimur Hassan
- Samet AkcaySASamet Akcay
- Mohammed BennamounMBMohammed Bennamoun
- Salman KhanSKSalman Khan
- Naoufel WerghiNWNaoufel Werghi
Preprint
Abstract
Automated systems designed for screening contraband items from the X-ray imagery are still facing difficulties with high clutter, concealment, and extreme occlusion. In this paper, we addressed this challenge using a novel multi-scale contour instance segmentation framework that effectively identifies the cluttered contraband data within the baggage X-ray scans. Unlike standard models that employ region-based or keypoint-based techniques to generate multiple boxes around objects, we propose to derive proposals according to the hierarchy of the regions defined by the contours. The proposed framework is rigorously validated on three public datasets, dubbed GDXray, SIXray, and OPIXray, where it outperforms the state-of-the-art methods by achieving the mean average precision score of 0.9779, 0.9614, and 0.8396, respectively. Furthermore, to the best of our knowledge, this is the first contour instance segmentation framework that leverages multi-scale information to recognize cluttered and concealed contraband data from the colored and grayscale security X-ray imagery.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Towards automatic threat detection: A survey of advances of deep learning within X-ray security imagingPattern Recognition, 2022
- Nondestructive Defect Detection in Castings by Using Spatial Attention Bilinear Convolutional Neural NetworkIEEE Transactions on Industrial Informatics, 2020
- Evaluating the Transferability and Adversarial Discrimination of Convolutional Neural Networks for Threat Object Detection and Classification within X-Ray Security Imagery2019
- “Unexpected Item in the Bagging Area”: Anomaly Detection in X-Ray Security ImagesIEEE Transactions on Information Forensics and Security, 2018
- Using Deep Convolutional Neural Network Architectures for Object Classification and Detection Within X-Ray Baggage Security ImageryIEEE Transactions on Information Forensics and Security, 2018
- Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- GDXray: The Database of X-ray Images for Nondestructive TestingJournal of Nondestructive Evaluation, 2015
- Automated Detection of Threat Objects Using Adapted Implicit Shape ModelIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015