Identification and Tracking of Vehicles between Multiple Cameras on Bridges Using a YOLOv4 and OSNet-Based Method
Open Access
Abstract
The estimation of vehicle loads is a rising research hotspot in bridge structure health monitoring (SHM). Traditional methods, such as the bridge weight-in-motion system (BWIM), are widely used but they fail to record the locations of vehicles on the bridges. Computer vision-based approaches are promising ways for vehicle tracking on bridges. Nevertheless, keeping track of vehicles from the video frames of multiple cameras without an overlapped visual field poses a challenge for the tracking of vehicles across the whole bridge. In this study, a method that was You Only Look Once v4 (YOLOv4)- and Omni-Scale Net (OSNet)-based was proposed to realize vehicle detecting and tracking across multiple cameras. A modified IoU-based tracking method was proposed to track a vehicle in adjacent video frames from the same camera, which takes both the appearance of vehicles and overlapping rates between the vehicle bounding boxes into consideration. The Hungary algorithm was adopted to match vehicle photos in various videos. Moreover, a dataset with 25,080 images of 1727 vehicles for vehicle identification was established to train and evaluate four models. Field validation experiments based on videos from three surveillance cameras were conducted to validate the proposed method. Experimental results show that the proposed method has an accuracy of 97.7% in terms of vehicle tracking in the visual field of a single camera and over 92.5% in tracking across multiple cameras, which can contribute to the acquisition of the temporal–spatial distribution of vehicle loads on the whole bridge.Keywords
Funding Information
- China Postdoctoral Science Foundation (2022M712787, 52178306)
- National Natural Science Foundation of China (2022M712787, 52178306)
This publication has 44 references indexed in Scilit:
- Hybrid Sensor-Camera Monitoring for Damage Detection: Case Study of a Real BridgeJournal of Bridge Engineering, 2016
- Identification of spatio-temporal distribution of vehicle loads on long-span bridges using computer vision technologyStructural Control and Health Monitoring, 2015
- FaceNet: A unified embedding for face recognition and clustering2015
- A large-scale car dataset for fine-grained categorization and verification2015
- Bridge Damage Detection Using Weigh-in-Motion TechnologyJournal of Bridge Engineering, 2015
- A novel video based system for detecting and counting vehicles at user-defined virtual loopsExpert Systems with Applications, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Experimental and Numerical Studies of Nonstationary Random Vibrations for a High-Pier Bridge under Vehicular LoadsJournal of Bridge Engineering, 2013
- Experimental Assessment of Dynamic Responses Induced in Concrete Bridges by Permit VehiclesJournal of Bridge Engineering, 2011
- Algorithms for the Assignment and Transportation ProblemsJournal of the Society for Industrial and Applied Mathematics, 1957