Insect Classification Using Mel-CSTFT: A Fusion of Mel Spectrogram and Chroma STFT Features
Authors:
- 8 August 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Insect audio classification has witnessed substantial advancements in recent years, facilitated by the development of CNNs and deep learning architectures, which have demonstrated improved performance. Typically used hand-crafted features, specifically MFCCs, have consistently achieved state-of-the-art results in various signal processing research works. However, there is still a lot of scope, and since CNNs and deep neural networks have great capabilities in learning essential information from image-based features, sound signals extracted as visual representations, such as in the form of mel spectrograms, are now being frequently used for classification and detection purposes. To enhance the robustness and reliability of these features, researchers have adopted various techniques, including feature fusion, denoising, data augmentation, transfer learning, and attention mechanisms, etc. Therefore, this study presents a fusion called Mel-CSTFT, comprising of two sound features - mel spectrograms and chroma STFT, and conducts a performance analysis of this combination against the individual features. Ultimately, the aim is to identify whether this combination can outperform the performance of mel spectrograms, which have demonstrated impressive performance in multiple works, and to assess its robustness and reliability across a diverse and relatively bigger dataset.Keywords
This publication has 13 references indexed in Scilit:
- Enhancing Insect Sound Classification Using Dual-Tower Network: A Fusion of Temporal and Spectral Feature PerceptionApplied Sciences, 2024
- Mel Frequency Cepstral Coefficient and its Applications: A ReviewIEEE Access, 2022
- A ResNet attention model for classifying mosquitoes from wing-beating soundsScientific Reports, 2022
- Automated Applications of Acoustics for Stored Product Insect Detection, Monitoring, and ManagementInsects, 2021
- Detecting Aedes aegypti mosquitoes through audio classification with convolutional neural networksComputers in Biology and Medicine, 2021
- Environment Sound Classification Using Multiple Feature Channels and Attention Based Deep Convolutional Neural Network2020
- Urban Sound Classification Using Convolutional Neural Network and Long Short Term Memory Based on Multiple Features2020
- Musical instrument emotion recognition using deep recurrent neural networkProcedia Computer Science, 2020
- BioAcoustica: a free and open repository and analysis platform for bioacousticsDatabase: The Journal of Biological Databases and Curation, 2015
- librosa: Audio and Music Signal Analysis in Python2015