A Review of Physical and Perceptual Feature Extraction Techniques for Speech, Music and Environmental Sounds
Top Cited Papers
Open Access
- 12 May 2016
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 6 (5) , 143
Abstract
Endowing machines with sensing capabilities similar to those of humans is a prevalent quest in engineering and computer science. In the pursuit of making computers sense their surroundings, a huge effort has been conducted to allow machines and computers to acquire, process, analyze and understand their environment in a human-like way. Focusing on the sense of hearing, the ability of computers to sense their acoustic environment as humans do goes by the name of machine hearing. To achieve this ambitious aim, the representation of the audio signal is of paramount importance. In this paper, we present an up-to-date review of the most relevant audio feature extraction techniques developed to analyze the most usual audio signals: speech, music and environmental sounds. Besides revisiting classic approaches for completeness, we include the latest advances in the field based on new domains of analysis together with novel bio-inspired proposals. These approaches are described following a taxonomy that organizes them according to their physical or perceptual basis, being subsequently divided depending on the domain of computation (time, frequency, wavelet, image-based, cepstral, or other domains). The description of the approaches is accompanied with recent examples of their application to machine hearing related problems.Keywords
Funding Information
- European Commission (ENV/IT/001254)
- Secretaria d\''Universitats i Recerca del Departament d\''Economia i Coneixement (Generalitat de Catalunya (2014-SGR-0590)
This publication has 157 references indexed in Scilit:
- Hierarchical Classification of Environmental Noise Sources Considering the Acoustic Signature of Vehicle Pass-BysArchives of Acoustics, 2012
- Machine-learning based classification of speech and musicMultimedia Systems, 2006
- Toward semantic indexing and retrieval using hierarchical audio modelsMultimedia Systems, 2005
- A THEORY OF PRIMARY SENSATIONS AND SPATIAL SENSATIONS MEASURING ENVIRONMENTAL NOISEJournal of Sound and Vibration, 2001
- A time-domain, level-dependent auditory filter: The gammachirpThe Journal of the Acoustical Society of America, 1997
- Content-based classification, search, and retrieval of audioIEEE MultiMedia, 1996
- A computer model of amplitude-modulation sensitivity of single units in the inferior colliculusThe Journal of the Acoustical Society of America, 1994
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- Auditory filter shapes at low center frequenciesThe Journal of the Acoustical Society of America, 1990
- Perceptual linear predictive (PLP) analysis of speechThe Journal of the Acoustical Society of America, 1990