Background-Aware Classification Activation Map for Weakly Supervised Object Localization
- 29 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 45 (12) , 14175-14191
Abstract
Weakly supervised object localization (WSOL) relaxes the requirement of dense annotations for object localization by using image-level annotation to supervise the learning process. However, most WSOL methods only focus on forcing the object classifier to produce high activation score on object parts without considering the influence of background locations, causing excessive background activations and ill-pose background score searching. Based on this point, our work proposes a novel mechanism called the background-aware classification activation map (B-CAM) to add background awareness for WSOL training. Besides aggregating an object image-level feature for supervision, our B-CAM produces an additional background image-level feature to represent the pure-background sample. This additional feature can provide background cues for the object classifier to suppress the background activations on object localization maps. Moreover, our B-CAM also trained a background classifier with image-level annotation to produce adaptive background scores when determining the binary localization mask. Experiments indicate the effectiveness of the proposed B-CAM on four different types of WSOL benchmarks, including CUB-200, ILSVRC, OpenImages, and VOC2012 datasets.Keywords
Funding Information
- National Natural Science Foundation of China (82371112)
- Beijing Natural Science Foundation (Z210008)
- Peking University Medicine Sailing Program for Young Scholars’ Scientific & Technological Innovation (BMU2023YFJHMX007)
- Shenzhen Science and Technology Program, China (KQTD20180412181221912, JCYJ20200109140603831)
This publication has 58 references indexed in Scilit:
- Weakly-Supervised Learning of Visual Relations2017
- Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-Supervised Object and Action Localization2017
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Learning Deep Features for Discriminative Localization2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Visualizing and Understanding Convolutional Networks2014
- SLIC Superpixels Compared to State-of-the-Art Superpixel MethodsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Semantic contours from inverse detectors2011