Cross-Modal Music Retrieval and Applications: An Overview of Key Methodologies
- 25 December 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 36 (1) , 52-62
Abstract
There has been a rapid growth of digitally available music data, including audio recordings, digitized images of sheet music, album covers and liner notes, and video clips. This huge amount of data calls for retrieval strategies that allow users to explore large music collections in a convenient way. More precisely, there is a need for cross-modal retrieval algorithms that, given a query in one modality (e.g., a short audio excerpt), find corresponding information and entities in other modalities (e.g., the name of the piece and the sheet music). This goes beyond exact audio identification and subsequent retrieval of metainformation as performed by commercial applications like Shazam [1].Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (MU 2686/11-1)
- Österreichische Forschungsförderungsgesellschaft (SCCH)
- H2020 European Research Council (ERC-2014-AdG 670035)
This publication has 19 references indexed in Scilit:
- Robust Quad-Based Audio FingerprintingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Towards a Standard Testbed for Optical Music Recognition: Definitions, Metrics, and Page ImagesJournal of New Music Research, 2015
- Matching Musical Themes based on noisy OCR and OMR input2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Automatic music transcription: challenges and future directionsJournal of Intelligent Information Systems, 2013
- Tonal representations for music retrieval: from version identification to query-by-hummingInternational Journal of Multimedia Information Retrieval, 2012
- A digital library framework for heterogeneous music collections: from document acquisition to cross-modal interactionInternational Journal on Digital Libraries, 2012
- Audio Cover Song Identification and Similarity: Background, Approaches, Evaluation, and Beyond2010
- Music score alignment and computer accompanimentCommunications of the ACM, 2006
- A Review of Audio FingerprintingJournal of Signal Processing Systems, 2005