SDANet: Semantic-Embedded Density Adaptive Network for Moving Vehicle Detection in Satellite Videos
- 6 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 32 (10577149) , 1788-1801
Abstract
In satellite videos, moving vehicles are extremely small-sized and densely clustered in vast scenes. Anchor-free detectors offer great potential by predicting the keypoints and boundaries of objects directly. However, for dense small-sized vehicles, most anchor-free detectors miss the dense objects without considering the density distribution. Furthermore, weak appearance features and massive interference in the satellite videos limit the application of anchor-free detectors. To address these problems, a novel semantic-embedded density adaptive network (SDANet) is proposed. In SDANet, the cluster-proposals, including a variable number of objects, and centers are generated parallelly through pixel-wise prediction. Then, a novel density matching algorithm is designed to obtain each object via partitioning the cluster-proposals and matching the corresponding centers hierarchically and recursively. Meanwhile, the isolated cluster-proposals and centers are suppressed. In SDANet, the road is segmented in vast scenes and its semantic features are embedded into the network by weakly supervised learning, which guides the detector to emphasize the regions of interest. By this way, SDANet reduces the false detection caused by massive interference. To alleviate the lack of appearance information on small-sized vehicles, a customized bi-directional conv-RNN module extracts the temporal information from consecutive input frames by aligning the disturbed background. The experimental results on Jilin-1 and SkySat satellite videos demonstrate the effectiveness of SDANet, especially for dense objects.Keywords
Funding Information
- National Natural Science Foundation of China (62271374, 62176200, 62077038, 62176196)
- State Key Program of National Natural Science of China (61836009)
- Young Elite Scientists Sponsorship Program by the China Association for Science and Technology (2020QNRC001)
- Natural Science Basic Research Program of Shaanxi (2022GY-065, 2022JC-45)
This publication has 33 references indexed in Scilit:
- YOLO9000: Better, Faster, Stronger2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- A four-frames differencing technique for moving objects detection in wide area surveillance2017
- Stacked Hourglass Networks for Human Pose Estimation2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Fast R-CNN2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Efficient Graph-Based Image SegmentationInternational Journal of Computer Vision, 2004