Danbinaerin Han
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Danbinaerin Han has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Dasaem Jeong
Sogang University, Seoul, South Korea
2 shared publications - Daewoong Kim
Department of Artificial Intelligence, Sogang University, South Korea
1 shared publication - Dongmin Kim
Department of Artificial Intelligence, Sogang University, Seoul, South Korea
1 shared publication - Jose J. Valero-Mas
University of Alicante
1 shared publication
Latest Publications
- Open Access
- 9 September 2025
- Published by Association for Computing Machinery (ACM) in Journal on Computing and Cultural Heritage
- Vol. 18 (3) , 1-21
On the Automatic Recognition of Jeongganbo Music Notation: Dataset and Approach
The Jeongganbo notation, the first music representation system in East Asia capable of jointly expressing pitch and duration, has been extensively used—and still is—in the Korean music tradition since its inception in the 15th century. In this regard, there exists a plethora of music works that exclusively endure as physical sheets, which not only constitutes a heritage preservation challenge due to the inherent degradation of this format but also impedes the use of computational tools to study and exploit this music tradition. While the Optical Music Recognition (OMR) field, which represents the research area devoted to devising methods capable of automatically transcribing music sheets into digital formats, has addressed this issue in a number of music notations from the Western tradition, no previous research has considered the preservation of Jeongganbo scores. In this context, this work presents the following contributions: (i) the first data assortment of real Jeongganbo scores for OMR tasks; (ii) a collection of synthetic data generation and augmentation mechanisms to alleviate the scarcity of manual annotation; and (iii) a neural-based transcription scheme based on state-of-the-art OMR strategies specifically tailored to Jeongganbo scores. The experiments performed prove the validity of the approach—performance rates close to a 90% of success—and open new research avenues for under-resourced yet challenging music notations.
- 9 September 2025
- Published by Association for Computing Machinery (ACM) in Journal on Computing and Cultural Heritage
- Vol. 18 (3) , 1-21
Open AccessOn the Automatic Recognition of Jeongganbo Music Notation: Dataset and Approach
The Jeongganbo notation, the first music representation system in East Asia capable of jointly expressing pitch and duration, has been extensively used—and still is—in the Korean music tradition since its inception in the 15th century. In this regard, there exists a plethora of music works that exclusively endure as physical sheets, which not only constitutes a heritage preservation challenge due to the inherent degradation of this format but also impedes the use of computational tools to study and exploit this music tradition. While the Optical Music Recognition (OMR) field, which represents the research area devoted to devising methods capable of automatically transcribing music sheets into digital formats, has addressed this issue in a number of music notations from the Western tradition, no previous research has considered the preservation of Jeongganbo scores. In this context, this work presents the following contributions: (i) the first data assortment of real Jeongganbo scores for OMR tasks; (ii) a collection of synthetic data generation and augmentation mechanisms to alleviate the scarcity of manual annotation; and (iii) a neural-based transcription scheme based on state-of-the-art OMR strategies specifically tailored to Jeongganbo scores. The experiments performed prove the validity of the approach—performance rates close to a 90% of success—and open new research avenues for under-resourced yet challenging music notations.
- Open Access
- 10 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 7-11
Aligning Incomplete Lyrics of Korean Folk Song Dataset using Whisper
In this study, we introduce a method for time-alignment of lyrics in Korean folk song audio using a transformer encoder-decoder model specifically designed to utilize incomplete lyric data. We analyzed the characteristics of Korean folk song lyrics and found some discrepancies between the lyrics and the corresponding audio recordings. To address these challenges and maximize the use of existing transcriptions, we introduce RefWhisper. This is a variant of OpenAI’s Whisper and includes an extra encoder module and cross-attention layer, enabling the model to consult incomplete lyrics during the transcription process. The added cross-attention layer facilitates not only the alignment of the reference text with the predicted transcription but also with the audio. We make public the transcribed outcomes and timestamp data, which are aligned at both the sentence and word levels, for a corpus of 13,801 Korean folk songs.
- 10 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 7-11
Open AccessAligning Incomplete Lyrics of Korean Folk Song Dataset using Whisper
In this study, we introduce a method for time-alignment of lyrics in Korean folk song audio using a transformer encoder-decoder model specifically designed to utilize incomplete lyric data. We analyzed the characteristics of Korean folk song lyrics and found some discrepancies between the lyrics and the corresponding audio recordings. To address these challenges and maximize the use of existing transcriptions, we introduce RefWhisper. This is a variant of OpenAI’s Whisper and includes an extra encoder module and cross-attention layer, enabling the model to consult incomplete lyrics during the transcription process. The added cross-attention layer facilitates not only the alignment of the reference text with the predicted transcription but also with the audio. We make public the transcribed outcomes and timestamp data, which are aligned at both the sentence and word levels, for a corpus of 13,801 Korean folk songs.