Spatiotemporal Interaction Transformer Network for Video-Based Person Reidentification in Internet of Things
- 1 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (14) , 12537-12547
Abstract
Video-based person reidentification, which is a significant application in the Internet of Things, aims to identify the same person in different video sequences across nonoverlapping cameras. Existing methods usually utilize temporal cues to enhance spatial features. However, these methods learn the temporal and spatial information separately, which breaks the relationship between them and ignores the positive role of temporal information for learning frame-level spatial representation in the process of spatial representation learning. In this article, we propose a novel spatiotemporal interaction transformer network (SITN) to solve this problem. To model the temporal information and the relationship between frames, we introduce a temporal interaction module (TIM) to interact between frame information. Meanwhile, we combine TIM with spatial transformer encoder to explore the positive role of temporal information in the learning procedure of the frame-level spatial feature. Moreover, we propose a transformer local learning scheme by reconstructing the 2-D spatial information of the frame patch sequences and extracting local features in a striped manner to strengthen the discriminative capability of our model. Extensive experiments are conducted on four public benchmarks. The results show that our model is superior compared with state-of-the-art methods.Keywords
Funding Information
- Funding from Sichuan University (2020SCUNG205, 2021SCUVS005)
- Project of Sichuan Science and Technology Department (2022YFG0153)
- Opening Project of State Key Laboratory of Explosion Science and Technology from Beijing Institute of Technology (KFJJ23-06M)
This publication has 52 references indexed in Scilit:
- Stepwise Metric Promotion for Unsupervised Video Person Re-identification2017
- Large Margin Learning in Set to Set Similarity Comparison for Person Re-identificationIEEE Transactions on Multimedia, 2017
- Discriminative Structural Metric Learning for Person Reidentification in Visual Internet of ThingsIEEE Internet of Things Journal, 2017
- See the Forest for the Trees: Joint Spatial and Temporal Recurrent Neural Networks for Video-Based Person Re-identification2017
- Learning Bidirectional Temporal Cues for Video-Based Person Re-IdentificationIEEE Transactions on Circuits and Systems for Video Technology, 2017
- Person Re-identification via Recurrent Feature Aggregation2016
- MARS: A Video Benchmark for Large-Scale Person Re-Identification2016
- Recurrent Convolutional Network for Video-Based Person Re-identification2016
- Person Re-identification by Video Ranking2014
- Person Re-identification by Descriptive and Discriminative Classification2011