Scale and Background Aware Asymmetric Bilateral Network for Unconstrained Image Crowd Counting
Open Access
- 25 March 2022
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 10 (7) , 1053
Abstract
This paper attacks the two challenging problems of image-based crowd counting, that is, scale variation and complex background. To that end, we present a novel crowd counting method, called the Scale and Background aware Asymmetric Bilateral Network (SBAB-Net), which is able to handle scale variation and background noise in a unified framework. Specifically, the proposed SBAB-Net contains three main components, a pre-trained backbone convolutional neural network (CNN) as the feature extractor and two asymmetric branches to generate a density map. These two asymmetric branches have different structures and use features from different semantic layers. One branch is densely connected stacked dilated convolution (DCSDC) sub-network with different dilation rates, which relies on one deep feature layer and can handle scale variation. The other branch is parameter-free densely connected stacked pooling (DCSP) sub-network with various pooling kernels and strides, which relies on shallow feature and can fuse features with several receptive fields to reduce the impact of background noise. Two sub-networks are fused by the attention mechanism to generate the final density map. Extensive experimental results on three widely-used benchmark datasets have demonstrated the effectiveness and superiority of our proposed method: (1) We achieve competitive counting performance compared to state-of-the-art methods; (2) Compared with baseline, the MAE and MSE are decreased by at least and , respectively.
Keywords
Funding Information
- The University Synergy Innovation Program of Anhui Province (GXXT-2019-048)
- National Natural Science Foundation of China (61902104)
- the National Key R\&D Program (2020YFC2005603)
- Natural Science Foundation of Anhui Province (2008085QF295)
- University Natural Sciences Research Project of Anhui Province (KJ2020A0651)
This publication has 56 references indexed in Scilit:
- DA-Net: Learning the Fine-Grained Density Distribution With Deformation Aggregation NetworkIEEE Access, 2018
- Generating High-Quality Crowd Density Maps Using Contextual Pyramid CNNs2017
- Body Structure Aware Deep Crowd CountingIEEE Transactions on Image Processing, 2017
- Switching Convolutional Neural Network for Crowd Counting2017
- Dense crowd counting from still images with convolutional neural networksJournal of Visual Communication and Image Representation, 2016
- COUNT Forest: CO-Voting Uncertain Number of Targets Using Random Forest for Crowd Density Estimation2015
- Fast crowd density estimation with convolutional neural networksEngineering Applications of Artificial Intelligence, 2015
- Detecting Humans in Dense Crowds Using Locally-Consistent Scale Prior and Global Occlusion ReasoningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Crowded Scene Analysis: A SurveyIEEE Transactions on Circuits and Systems for Video Technology, 2014
- Multi-source Multi-scale Counting in Extremely Dense Crowd Images2013