LyricSynchronizer: Automatic Synchronization System Between Musical Audio Signals and Lyrics
- 16 June 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 5 (6) , 1252-1261
Abstract
This paper describes a system that can automatically synchronize polyphonic musical audio signals with their corresponding lyrics. Although methods for synchronizing monophonic speech signals and corresponding text transcriptions by using Viterbi alignment techniques have been proposed, these methods cannot be applied to vocals in CD recordings because vocals are often overlapped by accompaniment sounds. In addition to a conventional method for reducing the influence of the accompaniment sounds, we therefore developed four methods to overcome this problem: a method for detecting vocal sections, a method for constructing robust phoneme networks, a method for detecting fricative sounds, and a method for adapting a speech-recognizer phone model to segregated vocal signals. We then report experimental results for each of these methods and also describe our music playback interface that utilizes our system for synchronizing music and lyrics.Keywords
This publication has 18 references indexed in Scilit:
- A Modeling of Singing Voice Robust to Accompaniment Sounds and Its Application to Singer Identification and Vocal-Timbre-Similarity-Based Music Information RetrievalIEEE Transactions on Audio, Speech, and Language Processing, 2010
- Active Music Listening Interfaces Based on Signal Processing2007
- Automatic lyrics alignment for Cantonese popular musicMultimedia Systems, 2006
- Pitch-Dependent Identification of Musical Instrument SoundsApplied Intelligence, 2005
- A real-time music-scene-description system: predominant-F0 estimation for detecting melody and bass lines in real-world audio signalsSpeech Communication, 2004
- Accurate keyword spotting using strictly lexical fillers2002
- A segment-based wordspotter using phonetic filler models2002
- Locating singing voice segments within music signals2002
- Adaptive cepstral analysis of speechIEEE Transactions on Speech and Audio Processing, 1995
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979