Moving vehicle detection using acoustic and seismic signals with cross-modal fusion model
- 20 February 2026
- journal article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 37 (7) , 076001
Abstract
This paper investigates field moving vehicle detection using field-measured acoustic and seismic signals and proposes a detection algorithm based on cross-modal fusion model. First, the proposed method specifically extracts complementary features from both modalities and designs a transformer-based fusion framework. Second, three key components are further introduced: the modality alignment modules are employed to balance and improve feature representation quality; the bidirectional cross-attention layer is adopted to enable mutual learning and information complementation across modalities; and the gated fusion module is incorporated to ensure effective integration and discriminability of fused features. Finally, we construct a 76 h second-level vehicle detection dataset to evaluate the proposed fusion method. Ablation experiments verify the effectiveness of the important modules and the overall performance of the proposed method. Comparative results against existing detection algorithms and fusion-based methods demonstrate that our approach achieves superior performance, with F1-score of 0.8722, error rate of 0.0720, and AUC of 0.9652. While significantly improving vehicle detection performance, the proposed method maintains a moderate level of computational complexity, making it a promising solution for embedded applications.Keywords
This publication has 28 references indexed in Scilit:
- KDM-OPTICS based vehicle clustering algorithm for traffic millimeter-wave radarMeasurement Science and Technology, 2025
- Leveraging the voice recognition to detect the vehicle utilizing ensemble learning approachSignal, Image and Video Processing, 2025
- Vehicle identification and analysis based on lightweight YOLOv5 on edge computing platformMeasurement Science and Technology, 2024
- Acoustic Based Emergency Vehicle Detection Using Ensemble of deep Learning ModelsProcedia Computer Science, 2023
- Last Decade in Vehicle Detection and Classification: A Comprehensive SurveyArchives of Computational Methods in Engineering, 2022
- Gated attention fusion network for multimodal sentiment classificationKnowledge-Based Systems, 2022
- Moving target recognition with seismic sensing: A reviewMeasurement, 2021
- Traffic vehicle cognition in severe weather based on radar and infrared thermal camera fusionMeasurement Science and Technology, 2021
- Gated multimodal networksNeural Computing and Applications, 2020
- Acoustic–seismic detection and classification of military vehicles—developing tools for disarmament and peace-keepingApplied Acoustics, 2002