Omni-Scale Feature Learning for Person Re-Identification
Preprint
Abstract
As an instance-level recognition problem, person re-identification (ReID) relies on discriminative features, which not only capture different spatial scales but also encapsulate an arbitrary combination of multiple scales. We call features of both homogeneous and heterogeneous scales omni-scale features. In this paper, a novel deep ReID CNN is designed, termed Omni-Scale Network (OSNet), for omni-scale feature learning. This is achieved by designing a residual block composed of multiple convolutional streams, each detecting features at a certain scale. Importantly, a novel unified aggregation gate is introduced to dynamically fuse multi-scale features with input-dependent channel-wise weights. To efficiently learn spatial-channel correlations and avoid overfitting, the building block uses pointwise and depthwise convolutions. By stacking such block layer-by-layer, our OSNet is extremely lightweight and can be trained from scratch on existing ReID benchmarks. Despite its small model size, OSNet achieves state-of-the-art performance on six person ReID datasets, outperforming most large-sized models, often by a clear margin. Code and models are available at: \url{https://github.com/KaiyangZhou/deep-person-reid}.Keywords
All Related Versions
This publication has 61 references indexed in Scilit:
- Part-Aligned Bilinear Representations for Person Re-identification2018
- Person Re-identification with Deep Similarity-Guided Graph Neural Network2018
- Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net2018
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-Identification2018
- Pose-Normalized Image Generation for Person Re-identification2018
- Performance Measures and a Data Set for Multi-target, Multi-camera Tracking2016
- Identity Mappings in Deep Residual Networks2016
- Gated Siamese Convolutional Neural Network Architecture for Human Re-identification2016
- Multi-attribute learning for pedestrian attribute recognition in surveillance scenarios2015