Automatic segmentation and classification of mice ultrasonic vocalizations
Open Access
- 1 July 2022
- journal article
- research article
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 152 (1) , 266-280
Abstract
This paper addresses the development of a system for classifying mouse ultrasonic vocalizations (USVs) present in audio recordings. The automatic labeling process for USVs is usually divided into two main steps: USV segmentation followed by the matching classification. Three main contributions can be highlighted: (i) a new segmentation algorithm, (ii) a new set of features, and (iii) the discrimination of a higher number of classes when compared to similar studies. The developed segmentation algorithm is based on spectral entropy analysis. This novel segmentation approach can detect USVs with 94% and 74% recall and precision, respectively. When compared to other methods/software, our segmentation algorithm achieves a higher recall. Regarding the classification phase, besides the traditional features from time, frequency, and time-frequency domains, a new set of contour-based features were extracted and used as inputs of shallow machine learning classification models. The contour-based features were obtained from the time-frequency ridge representation of USVs. The classification methods can differentiate among ten different syllable types with 81.1% accuracy and 80.5% weighted F1-score. The algorithms were developed and evaluated based on a large dataset, acquired on diverse social interaction conditions between the animals, to stimulate a varied vocal repertoire.Keywords
This publication has 28 references indexed in Scilit:
- Affective communication in rodents: ultrasonic vocalizations as a tool for research on emotion and motivationCell and tissue research, 2013
- Automated extraction and classification of time-frequency contours in humpback vocalizationsThe Journal of the Acoustical Society of America, 2013
- Development of Social Vocalizations in MicePLOS ONE, 2011
- Understanding bag-of-words model: a statistical frameworkInternational Journal of Machine Learning and Cybernetics, 2010
- Unusual repertoire of vocalizations in adult BTBR T+tf/J mice during three types of social encountersGenes, Brain and Behavior, 2010
- Unusual Repertoire of Vocalizations in the BTBR T+tf/J Mouse Model of AutismPLOS ONE, 2008
- Affiliative Behavior, Ultrasonic Communication and Social Reward Are Influenced by Genetic Variation in Adolescent MicePLOS ONE, 2007
- Ultrasonic Songs of Male MicePLOS Biology, 2005
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- Induction of decision treesMachine Learning, 1986