Abstract
During the process of top coal caving, by monitoring the coal discharge status of the hydraulic support through sensors, it is possible to effectively achieve a balance between insufficient coal mining and excessive coal mining. Regarding the problem that the single-source sensor monitoring technology is susceptible to environmental influence and the feature extraction is insufficient, this study proposes a dual-modal fusion model based on acoustic-vibration signals.In the vibration branch, the time-domain graphs and time-frequency graphs of the three-axis vibration signals are used as inputs, while in the acoustic signal branch, the Mel spectrum and its first and second-order differences are used as inputs. In the calculation of the Mel spectrum, an adaptive band energy weighting method is proposed to enhance the feature details of the coal gangue signal in the Mel spectrum. In the feature extraction part, a channel-spatial fusion attention is designed, and the attention of the two dimensions is dynamically fused through adaptive learning. In the feature fusion part, a bidirectional cross-adaptive gated fusion attention is designed to promote the feature interaction between the two modalities and achieve information complementation and feature fusion. At the decision level, a residual branch and an auxiliary branch are added. The residual branch is used to compensate the confidence of the output of the main branch, and the auxiliary branch participates in decision fusion to further improve the performance of the model. Experimental verification shows that the model achieves an accuracy of 98.13% on the test set. In addition, this study designs a client-server dual-end linked upper computer monitoring system for this model, achieving endto-end real-time monitoring. This study further promotes the development of dual-modal fusion technology in the industrial detection field and provides new insights and research ideas for pattern recognition based on acoustic-vibration signals.
Funding Information
  • Shanxi Province Higher Education Teaching Reform and Innovation (J20240344)
  • National Natural Science Foundation of China (U23A20599)

This publication has 43 references indexed in Scilit: