Tomoyasu Nakano
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Tomoyasu Nakano has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Masataka Goto
National Institute of Advanced Industrial Science and Technology (AIST)
12 shared publications Hiromasa Fujihara
National Institute of Advanced Industrial Science and Technology (AIST)
3 shared publicationsKazuhiro Kobayashi
Graduate School of Information Science, Nara Institute of Science and Technology (NAIST), Japan
2 shared publications- Kazuyoshi Yoshii
Graduate School of Engineering, Kyoto University, Kyoto, Japan
2 shared publications - Masahiro Hamasaki
National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Ibaraki, Japan
2 shared publications Satoshi Nakamura
Graduate School of Information Science, Nara Institute of Science and Technology (NAIST), Japan
2 shared publications
Latest Publications
- 13 February 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 21-35
RWC Revisited: Towards a Community-Driven MIR Corpus
- 13 February 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 21-35
RWC Revisited: Towards a Community-Driven MIR Corpus
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Super Kawaii Vocalics: Amplifying the "Cute" Factor in Computer Voice
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessSuper Kawaii Vocalics: Amplifying the "Cute" Factor in Computer Voice
- 1 March 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5265-5269
An estimation method of voice timbre evaluation values using feature extraction with Gaussian mixture model based on reference singer
This paper presents an estimation method of voice timbre evaluation values for arbitrary singer's singing voices generated with a singing voice synthesis system towards the development of a singing voice retrieval system. The voice timbre evaluation values are numerical values corresponding to voice timbre expression words, such as "Age" and "Gender", and they usually need to be manually assigned to individual singers' singing voices through listening. To make it possible to automatically estimate them from given singer's singing voices, an acoustic feature to well capture only each singer's voice timbre is extracted with a Gaussian mixture model trained using parallel data between singing voices sung by many pre-stored target singers and same voices sung by a reference singer. Then, the voice timbre evaluation values are estimated from the extracted feature using regression models. The experimental results showed that the proposed method is capable of accurately estimating those values for some expression words, such as "Age" and "Gender", and nonlinear regression is effective for the expression words, "Powerfulness" and "Uniqueness."
- 1 March 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5265-5269
An estimation method of voice timbre evaluation values using feature extraction with Gaussian mixture model based on reference singer
This paper presents an estimation method of voice timbre evaluation values for arbitrary singer's singing voices generated with a singing voice synthesis system towards the development of a singing voice retrieval system. The voice timbre evaluation values are numerical values corresponding to voice timbre expression words, such as "Age" and "Gender", and they usually need to be manually assigned to individual singers' singing voices through listening. To make it possible to automatically estimate them from given singer's singing voices, an acoustic feature to well capture only each singer's voice timbre is extracted with a Gaussian mixture model trained using parallel data between singing voices sung by many pre-stored target singers and same voices sung by a reference singer. Then, the voice timbre evaluation values are estimated from the extracted feature using regression models. The experimental results showed that the proposed method is capable of accurately estimating those values for some expression words, such as "Age" and "Gender", and nonlinear regression is effective for the expression words, "Powerfulness" and "Uniqueness."
- 1 May 2014
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 624-628
Cultivating vocal activity detection for music audio signals in a circulation-type crowdsourcing ecosystem
This paper presents a crowdsourcing-based self-improvement framework of vocal activity detection (VAD) for music audio signals. A standard approach to VAD is to train a vocal-and-non-vocal classifier by using labeled audio signals (training set) and then use that classifier to label unseen signals. Using this technique, we have developed an online music-listening service called Songle that can help users better understand music by visualizing automatically estimated vocal regions and pitches of arbitrary songs existing on the Web. The accuracy of VAD is limited, however, because in general the acoustic characteristics of the training set are different from those of real songs on the Web. To overcome this limitation, we adapt a classifier by leveraging vocal regions and pitches corrected by volunteer users. UnlikeWikipedia-type crowdsourcing, our Songle-based framework can amplify user contributions: error corrections made for a limited number of songs improve VAD for all songs. This gives better music listening experiences to all users as non-monetary rewards.
- 1 May 2014
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 624-628
Cultivating vocal activity detection for music audio signals in a circulation-type crowdsourcing ecosystem
This paper presents a crowdsourcing-based self-improvement framework of vocal activity detection (VAD) for music audio signals. A standard approach to VAD is to train a vocal-and-non-vocal classifier by using labeled audio signals (training set) and then use that classifier to label unseen signals. Using this technique, we have developed an online music-listening service called Songle that can help users better understand music by visualizing automatically estimated vocal regions and pitches of arbitrary songs existing on the Web. The accuracy of VAD is limited, however, because in general the acoustic characteristics of the training set are different from those of real songs on the Web. To overcome this limitation, we adapt a classifier by leveraging vocal regions and pitches corrected by volunteer users. UnlikeWikipedia-type crowdsourcing, our Songle-based framework can amplify user contributions: error corrections made for a limited number of songs improve VAD for all songs. This gives better music listening experiences to all users as non-monetary rewards.
- 1 May 2014
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7904-7908
Regression approaches to perceptual age control in singing voice conversion
The perceptual age of a singing voice is the age of the singer as perceived by the listener, and is one of the notable characteristics that determines perceptions of a song. In this paper, we describe a novel voice timbre control technique based on the perceptual age for singing voice conversion (SVC). Singers can sing expressively by controlling prosody and voice timbre, but the varieties of voices that singers can produce are limited by physical constraints. Previous work has attempted to overcome the limitation through the use of statistical voice conversion. This technique makes it possible to convert singing voice timbre of an arbitrary source singer into that of an arbitrary target singer. However, it is still difficult to intuitively control singing voice characteristics by manipulating parameters corresponding to specific physical traits, such as gender and age. In this paper, we develop a technique for controlling the voice timbre based on perceptual age that maintains the singer's individuality. The experimental results show that the proposed voice timbre control method makes it possible to change the singer's perceptual age while not having an adverse effect on the perceived individuality.
- 1 May 2014
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7904-7908
Regression approaches to perceptual age control in singing voice conversion
The perceptual age of a singing voice is the age of the singer as perceived by the listener, and is one of the notable characteristics that determines perceptions of a song. In this paper, we describe a novel voice timbre control technique based on the perceptual age for singing voice conversion (SVC). Singers can sing expressively by controlling prosody and voice timbre, but the varieties of voices that singers can produce are limited by physical constraints. Previous work has attempted to overcome the limitation through the use of statistical voice conversion. This technique makes it possible to convert singing voice timbre of an arbitrary source singer into that of an arbitrary target singer. However, it is still difficult to intuitively control singing voice characteristics by manipulating parameters corresponding to specific physical traits, such as gender and age. In this paper, we develop a technique for controlling the voice timbre based on perceptual age that maintains the singer's individuality. The experimental results show that the proposed voice timbre control method makes it possible to change the singer's perceptual age while not having an adverse effect on the perceived individuality.
- Open Access
- 7 April 2014
- Published by Association for Computing Machinery (ACM)
- p. 523-528
Songrium
This paper describes a music browsing assistance service, Songrium (http://songrium.jp), which increases user enjoyment when listening to songs and allows visualization and exploration of a ``Web of Music''. We define a Web of Music in this paper to be a network of ``web-native music'', which we define in turn to be music that is published, shared, and remixed (has derivative works created) entirely on the web. Songrium was developed as an attempt to realize a Web of Music, by showing relations between both original songs and derivative works and offering an enriched listening experience. Songrium has analyzed over 600,000 music video clips on the most popular Japanese video-sharing service, Niconico, which contains original songs of web-native music and their derivative works such as covers and dance arrangements. Analysis of over 100,000 original songs reveals that over 500,000 derivative works were generated and have contributed to enrich the Web of Music.
- 7 April 2014
- Published by Association for Computing Machinery (ACM)
- p. 523-528
Open AccessSongrium
This paper describes a music browsing assistance service, Songrium (http://songrium.jp), which increases user enjoyment when listening to songs and allows visualization and exploration of a ``Web of Music''. We define a Web of Music in this paper to be a network of ``web-native music'', which we define in turn to be music that is published, shared, and remixed (has derivative works created) entirely on the web. Songrium was developed as an attempt to realize a Web of Music, by showing relations between both original songs and derivative works and offering an enriched listening experience. Songrium has analyzed over 600,000 music video clips on the most popular Japanese video-sharing service, Niconico, which contains original songs of web-native music and their derivative works such as covers and dance arrangements. Analysis of over 100,000 original songs reveals that over 500,000 derivative works were generated and have contributed to enrich the Web of Music.
- 1 January 2014
- Published by Japan Science and Technology Agency (JST) in Journal of Information Processing and Management
- Vol. 56 (11) , 739-749
Music information processing research related to Hatsune Miku and N-th Order Derivative Creation : VocaListener and Songrium
- 1 January 2014
- Published by Japan Science and Technology Agency (JST) in Journal of Information Processing and Management
- Vol. 56 (11) , 739-749
Music information processing research related to Hatsune Miku and N-th Order Derivative Creation : VocaListener and Songrium
- 1 March 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 5393-5396
VocaListener and VocaWatcher: Imitating a human singer by using signal processing
In this paper, we describe three singing information processing systems, VocaListener, VocaListener2, and VocaWatcher, that imitate singing expressions of the voice and face of a human singer. VocaListener can synthesize natural singing voices by analyzing and imitating the pitch and dynamics of the human singing. VocaListener2 imitates temporal timbre changes in addition to the pitch and dynamics. In synchronization with the synthesized singing voices, VocaWatcher can generate realistic facial motions of a humanoid robot, the HRP-4C, by analyzing and imitating facial motions of a human singing that are recorded by a single video camera. These systems that focus on “imitation” are not only promising for representing human-like naturalness, but also useful for providing intuitive control means.
- 1 March 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 5393-5396
VocaListener and VocaWatcher: Imitating a human singer by using signal processing
In this paper, we describe three singing information processing systems, VocaListener, VocaListener2, and VocaWatcher, that imitate singing expressions of the voice and face of a human singer. VocaListener can synthesize natural singing voices by analyzing and imitating the pitch and dynamics of the human singing. VocaListener2 imitates temporal timbre changes in addition to the pitch and dynamics. In synchronization with the synthesized singing voices, VocaWatcher can generate realistic facial motions of a humanoid robot, the HRP-4C, by analyzing and imitating facial motions of a human singing that are recorded by a single video camera. These systems that focus on “imitation” are not only promising for representing human-like naturalness, but also useful for providing intuitive control means.
- 1 February 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 298-299
PodCastle and songle: Crowdsourcing-based web services for spoken document retrieval and active music listening
In this talk, we describe two web services for speech and music, PodCastle (Figure 1) and Songle (Figure 2), that collect and amplify voluntary contributions by anonymous users to improve user experiences. Our goal is to provide users with public web services based on speech recognition, music understanding, signal processing, machine learning, and crowdsourcing so that they can experience state-of-the-art research-level technologies through useful services.
- 1 February 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 298-299
PodCastle and songle: Crowdsourcing-based web services for spoken document retrieval and active music listening
In this talk, we describe two web services for speech and music, PodCastle (Figure 1) and Songle (Figure 2), that collect and amplify voluntary contributions by anonymous users to improve user experiences. Our goal is to provide users with public web services based on speech recognition, music understanding, signal processing, machine learning, and crowdsourcing so that they can experience state-of-the-art research-level technologies through useful services.
- 1 September 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 2000-2007
VocaWatcher: Natural singing motion generator for a humanoid robot
In this paper, we describe VocaWatcher, a novel robot motion generator that enables a humanoid robot to sing with realistic facial expressions and naturally synthesized singing voices. This robot singer is an important and attractive humanoid robot application for the entertainment scene; moreover, it promotes state-of-the-art integration of robot engineering, music processing, and image processing. To overcome the difficulties of generating natural facial expressions that are precisely synchronized with singing voices, VocaWatcher imitates a human singer by analyzing a video clip of a human singing, recorded by a single video camera. VocaWatcher can control mouth, eye, and neck motions by imitating the corresponding human movements, which are estimated without using any markers in the video. It can also synthesize singing voices by imitating the pitch and dynamics of the human singing in the same video.
- 1 September 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 2000-2007
VocaWatcher: Natural singing motion generator for a humanoid robot
In this paper, we describe VocaWatcher, a novel robot motion generator that enables a humanoid robot to sing with realistic facial expressions and naturally synthesized singing voices. This robot singer is an important and attractive humanoid robot application for the entertainment scene; moreover, it promotes state-of-the-art integration of robot engineering, music processing, and image processing. To overcome the difficulties of generating natural facial expressions that are precisely synchronized with singing voices, VocaWatcher imitates a human singer by analyzing a video clip of a human singing, recorded by a single video camera. VocaWatcher can control mouth, eye, and neck motions by imitating the corresponding human movements, which are estimated without using any markers in the video. It can also synthesize singing voices by imitating the pitch and dynamics of the human singing in the same video.