Oriented Bounding Boxes for Small and Freely Rotated Objects
- 5 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-15
Abstract
A novel object detection method is presented that handles freely rotated objects of arbitrary sizes, including tiny objects as small as $2 \times 2$ pixels. Such tiny objects appear frequently in remotely sensed images, and present a challenge to recent object detection algorithms. More importantly, current object detection methods have been designed originally to accommodate axis-aligned bounding box detection, and therefore fail to accurately localize oriented boxes that best describe freely rotated objects. In contrast, the proposed convolutional neural network (CNN) -based approach uses potential pixel information at multiple scale levels without the need for any external resources, such as anchor boxes. The method encodes the precise location and orientation of features of the target objects at grid cell locations. Unlike existing methods that regress the bounding box location and dimension, the proposed method learns all the required information by classification, which has the added benefit of enabling oriented bounding box detection without any extra computation. It thus infers the bounding boxes only at inference time by finding the minimum surrounding box for every set of the same predicted class labels. Moreover, a rotation-invariant feature representation is applied to each scale, which imposes a regularization constraint to enforce covering the 360° range of in-plane rotation of the training samples to share similar features. Evaluations on the xView and dataset for object detection in aerial images (DOTA) data sets show that the proposed method uniformly improves performance over existing state-of-the-art methods.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council (NSERC) Canada
This publication has 50 references indexed in Scilit:
- A survey on object detection in optical remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Ship Rotated Bounding Box Space for Ship Extraction From High-Resolution Optical Satellite Images With Complex BackgroundsIEEE Geoscience and Remote Sensing Letters, 2016
- Fast R-CNN2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Orientation robust object detection in aerial images using deep convolutional neural network2015
- Going deeper with convolutions2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Topological structural analysis of digitized binary images by border followingComputer Vision, Graphics, and Image Processing, 1985
- Finding the convex hull of a simple polygonPattern Recognition Letters, 1982