A Novel Incremental Learning Driven Instance Segmentation Framework to Recognize Highly Cluttered Instances of the Contraband Items
- 13 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 52 (11) , 6937-6951
Abstract
Screening cluttered and occluded contraband items from baggage X-ray scans is a cumbersome task even for the expert security staff. This article presents a novel strategy that extends a conventional encoder-decoder architecture to perform instance-aware segmentation and extract merged instances of contraband items without using any additional subnetwork or an object detector. The encoder-decoder network first performs conventional semantic segmentation and retrieves cluttered baggage items. The model then incrementally evolves during training to recognize individual instances using significantly reduced training batches. To avoid catastrophic forgetting, a novel objective function minimizes the network loss in each iteration by retaining the previously acquired knowledge while learning new class representations and resolving their complex structural interdependencies through Bayesian inference. A thorough evaluation of our framework on two publicly available X-ray datasets shows that it outperforms state-of-the-art methods, especially within the challenging cluttered scenarios, while achieving an optimal tradeoff between detection accuracy and efficiency.Keywords
All Related Versions
Funding Information
- research fund from Khalifa University (CIRA-2019-047)
- Abu Dhabi Department of Education and Knowledge (AARE19-156)
This publication has 51 references indexed in Scilit:
- Modern Computer Vision Techniques for X-Ray Testing in Baggage InspectionIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Object Recognition in Baggage Inspection Using Adaptive Sparse Representations of X-ray Images2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- GDXray: The Database of X-ray Images for Nondestructive TestingJournal of Nondestructive Evaluation, 2015
- Multi-view object detection in dual-energy X-ray imagesMachine Vision and Applications, 2015
- Automated Detection of Threat Objects Using Adapted Implicit Shape ModelIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015
- Fully convolutional networks for semantic segmentation2015
- Object Recognition in Multi-View Dual Energy X-ray Images2013