Masato Nakayama
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Masato Nakayama has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
Takanobu Nishiura
Ritsumeikan University,Japan
14 shared publicationsNoboru Nakasako
Faculty of Biology-Oriented Sci. and Technol., Kindai Univ., Kinokawa, Japan
9 shared publications- Takanobu Nishiura
College of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan
8 shared publications Tetsuji Uebo
Faculty of Biology-Oriented Sci. & Tech., Kindai Univ., Kinokawa, Nishi-mitani 930, Wakayama, Japan
6 shared publicationsToshihiro Shinohara
Faculty of Biology-Oriented Sci. & Tech., Kindai Univ., Kinikawa, Nishi-mitani 930, Wakayama, Japan
5 shared publicationsTakahiro Fukumori
4 shared publications
Latest Publications
- Open Access
Acoustic Metadata Design on Object-Based Audio Using Estimated 3D-Position from Visual Image Toward Depth-Directional Sound Image Localization
Multichannel audio is a sound field reproduction technology that uses multiple loudspeakers. Object-based audio is a playback method for multichannel audio that enables the construction of sound images at specified positions using coordinates within the playback space. However, the sound image positions must be manually specified by audio content creators, which increases the production workload, especially for works containing many sound images or feature films. We have previously proposed a method to reduce the workload of content creators by constructing sound images based on object positions in visual images. However, a significant challenge remains since depth localization of the sound image is not accurate enough. This paper aims to improve localization accuracy by changing the range of sound image movement along the depth direction. To confirm the localization accuracy of sound images constructed using the proposed method, we conducted a subjective evaluation experiment. The experiment identified the optimal movement range by presenting participants with visual images synchronized with sound images moving across varying spatial scales. Consequently, we were able to identify the range of sound image movement in the depth direction necessary for presenting sound images with high consistency with the visual images.
Open AccessAcoustic Metadata Design on Object-Based Audio Using Estimated 3D-Position from Visual Image Toward Depth-Directional Sound Image Localization
Multichannel audio is a sound field reproduction technology that uses multiple loudspeakers. Object-based audio is a playback method for multichannel audio that enables the construction of sound images at specified positions using coordinates within the playback space. However, the sound image positions must be manually specified by audio content creators, which increases the production workload, especially for works containing many sound images or feature films. We have previously proposed a method to reduce the workload of content creators by constructing sound images based on object positions in visual images. However, a significant challenge remains since depth localization of the sound image is not accurate enough. This paper aims to improve localization accuracy by changing the range of sound image movement along the depth direction. To confirm the localization accuracy of sound images constructed using the proposed method, we conducted a subjective evaluation experiment. The experiment identified the optimal movement range by presenting participants with visual images synchronized with sound images moving across varying spatial scales. Consequently, we were able to identify the range of sound image movement in the depth direction necessary for presenting sound images with high consistency with the visual images.
- Open Access
- 31 October 2025
- Published by MDPI AG in Journal of Experimental and Theoretical Analyses
- Vol. 3  (4) , 34
Head Orientation Estimation Based on Multiple Frequency Bands Using Sparsely Aligned Microphones
We describe the problem of estimating the speaker’s head orientation from the asynchronous multi-channel waveforms observed by microphones distributed in a room. In particular, we address a novel problem of estimating head orientation from sound captured by fewer microphones than the number of distinct head orientations to be distinguished. This is because the head orientation is an important clue indicating the speaker’s intended conversational partners. Head orientation estimation technology is an essential technology within environmental intelligence technology, which uses sensors embedded in rooms to monitor and support people’s activities. We propose a head orientation estimation method that aims to achieve high angular resolution using a small number of microphones. The proposed method achieves high estimation accuracy by using the spatial radiation pattern of the sound source as clues and by integrating information from multiple frequency bands. We conducted an experiment to estimate head orientation with an angular resolution of under observation conditions using six microphones. Experimental results showed that higher estimation accuracy was obtained than the conventional method using distributed microphone arrays (Oriented Global Coherence Field method) and the conventional method using distributed microphones (Radiation Pattern Matching method). The proposed method utilizing multiple frequency bands achieved the best performance with a mean absolute error of in the task of classifying 24 distinct head orientations.- 31 October 2025
- Published by MDPI AG in Journal of Experimental and Theoretical Analyses
- Vol. 3  (4) , 34
Open AccessHead Orientation Estimation Based on Multiple Frequency Bands Using Sparsely Aligned Microphones
We describe the problem of estimating the speaker’s head orientation from the asynchronous multi-channel waveforms observed by microphones distributed in a room. In particular, we address a novel problem of estimating head orientation from sound captured by fewer microphones than the number of distinct head orientations to be distinguished. This is because the head orientation is an important clue indicating the speaker’s intended conversational partners. Head orientation estimation technology is an essential technology within environmental intelligence technology, which uses sensors embedded in rooms to monitor and support people’s activities. We propose a head orientation estimation method that aims to achieve high angular resolution using a small number of microphones. The proposed method achieves high estimation accuracy by using the spatial radiation pattern of the sound source as clues and by integrating information from multiple frequency bands. We conducted an experiment to estimate head orientation with an angular resolution of under observation conditions using six microphones. Experimental results showed that higher estimation accuracy was obtained than the conventional method using distributed microphone arrays (Oriented Global Coherence Field method) and the conventional method using distributed microphones (Radiation Pattern Matching method). The proposed method utilizing multiple frequency bands achieved the best performance with a mean absolute error of in the task of classifying 24 distinct head orientations. - Open Access
- 28 March 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15  (7) , 3744
Virtual Sound Source Construction Based on Direct-to-Reverberant Ratio Control Using Multiple Pairs of Parametric-Array Loudspeakers and Conventional Loudspeakers
We propose a new method for constructing a virtual sound source (VSS) based on the direct-to-reverberant ratio (DRR) of room impulse responses (RIRs), using multiple pairs of parametric-array loudspeakers (PALs) and conventional loudspeakers (hereafter referred to simply as loudspeakers). In this paper, we focus on the differences in the DRRs of the RIRs generated by PALs and loudspeakers. The DRR of an RIR is recognized as a key cue for distance perception. A PAL can achieve super-directivity using an array of ultrasonic transducers. Its RIR exhibits a high DRR, characterized by a large-amplitude direct wave and low-amplitude reverberations. Consequently, a PAL makes the VSS appear to be closer to the listener. In contrast, a loudspeaker causes the VSS to be perceived as farther away because the sound it emits has a low DRR. The proposed method leverages the differences in the DRRs of the RIRs between PALs and loudspeakers. It controls the perceived distance of the VSS by reproducing the desired DRR at the listener’s position through a weighted combination of the RIRs emitted from PALs and loudspeakers into the air. Additionally, the proposed method adjusts the direction of the VSS using vector-based amplitude panning (VBAP). Finally, we have confirmed the effectiveness of the proposed method through evaluation experiments.
- 28 March 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15  (7) , 3744
Open AccessVirtual Sound Source Construction Based on Direct-to-Reverberant Ratio Control Using Multiple Pairs of Parametric-Array Loudspeakers and Conventional Loudspeakers
We propose a new method for constructing a virtual sound source (VSS) based on the direct-to-reverberant ratio (DRR) of room impulse responses (RIRs), using multiple pairs of parametric-array loudspeakers (PALs) and conventional loudspeakers (hereafter referred to simply as loudspeakers). In this paper, we focus on the differences in the DRRs of the RIRs generated by PALs and loudspeakers. The DRR of an RIR is recognized as a key cue for distance perception. A PAL can achieve super-directivity using an array of ultrasonic transducers. Its RIR exhibits a high DRR, characterized by a large-amplitude direct wave and low-amplitude reverberations. Consequently, a PAL makes the VSS appear to be closer to the listener. In contrast, a loudspeaker causes the VSS to be perceived as farther away because the sound it emits has a low DRR. The proposed method leverages the differences in the DRRs of the RIRs between PALs and loudspeakers. It controls the perceived distance of the VSS by reproducing the desired DRR at the listener’s position through a weighted combination of the RIRs emitted from PALs and loudspeakers into the air. Additionally, the proposed method adjusts the direction of the VSS using vector-based amplitude panning (VBAP). Finally, we have confirmed the effectiveness of the proposed method through evaluation experiments.
- Open Access
- 12 February 2025
- Published by MDPI AG in Electronics
- Vol. 14  (4) , 711
Simultaneous Localization of Two Talkers Placed in an Area Surrounded by Asynchronous Six-Microphone Arrays
If we can understand dialogue activities, it will be possible to know the role of each person in the discussion, and it will be possible to provide basic materials for formulating facilitation strategies. This understanding can be expected to be used for business negotiations, group work, active learning, etc. To develop a system that can monitor speech activity over a wide range of areas, we propose a method for detecting multiple acoustic events and localizing sound sources using an asynchronous distributed microphone array arranged in a regular hexagonal repeating structure. In contrast to conventional methods based on sound source direction using triangulation with microphone arrays, we propose a method for detecting acoustic events and determining sound sources from local maximum positions based on estimation of the spatial energy distribution inside the observation space. We evaluated the conventional method and the proposed method in an experimental environment in which a dialogue between two people was simulated under 22,104 conditions by using the sound source signal convolving the measured impulse response.We found that the performance changes depending on the selection of the microphone array used for estimation. Our finding is that it is best to choose five microphone arrays close to the evaluation position.
- 12 February 2025
- Published by MDPI AG in Electronics
- Vol. 14  (4) , 711
Open AccessSimultaneous Localization of Two Talkers Placed in an Area Surrounded by Asynchronous Six-Microphone Arrays
If we can understand dialogue activities, it will be possible to know the role of each person in the discussion, and it will be possible to provide basic materials for formulating facilitation strategies. This understanding can be expected to be used for business negotiations, group work, active learning, etc. To develop a system that can monitor speech activity over a wide range of areas, we propose a method for detecting multiple acoustic events and localizing sound sources using an asynchronous distributed microphone array arranged in a regular hexagonal repeating structure. In contrast to conventional methods based on sound source direction using triangulation with microphone arrays, we propose a method for detecting acoustic events and determining sound sources from local maximum positions based on estimation of the spatial energy distribution inside the observation space. We evaluated the conventional method and the proposed method in an experimental environment in which a dialogue between two people was simulated under 22,104 conditions by using the sound source signal convolving the measured impulse response.We found that the performance changes depending on the selection of the microphone array used for estimation. Our finding is that it is best to choose five microphone arrays close to the evaluation position.
- Open Access
- 1 January 2025
- Published by Acoustical Society of Japan in Acoustical Science and Technology
- p. e25.95
Multichannel feedforward active noise control system with an optical laser microphone and a distant air-conduction microphone for noise reduction in a real system
A conventional feedforward active noise control system suffers from degraded performance of noise reduction due to the causality constraint caused by processing and propagation delays. To address this issue, we propose a multichannel feedforward active noise control system that combines an optical laser microphone and an air-conduction microphone. The proposed system relaxes the causality constraint by acquiring vibration information at the speed of light using the optical laser microphone and enhances coherence using the signal of the air-conduction microphone. Experiments using a laser Doppler vibrometer and an electret condenser microphone demonstrate superior noise reduction compared to the conventional system.
- 1 January 2025
- Published by Acoustical Society of Japan in Acoustical Science and Technology
- p. e25.95
Open AccessMultichannel feedforward active noise control system with an optical laser microphone and a distant air-conduction microphone for noise reduction in a real system
A conventional feedforward active noise control system suffers from degraded performance of noise reduction due to the causality constraint caused by processing and propagation delays. To address this issue, we propose a multichannel feedforward active noise control system that combines an optical laser microphone and an air-conduction microphone. The proposed system relaxes the causality constraint by acquiring vibration information at the speed of light using the optical laser microphone and enhances coherence using the signal of the air-conduction microphone. Experiments using a laser Doppler vibrometer and an electret condenser microphone demonstrate superior noise reduction compared to the conventional system.
- Open Access
- 19 December 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (24) , 11911
Enhanced Virtual Sound Source Construction Based on Wave Field Synthesis Using Crossfade Processing with Electro-Dynamic and Parametric Loudspeaker Arrays
Wave field synthesis (WFS) can be used to construct virtual sound sources (VSSs) with a loudspeaker array. Conventional methods using a single type of loudspeaker showed limited performance in distance perception. For example, WFS with electro-dynamic loudspeakers (EDLs) has the advantage of constructing VSSs near the loudspeaker, while WFS with parametric array loudspeakers (PALs) has the advantage of constructing VSSs far from the loudspeaker. In this paper, we propose a VSS construction method utilizing crossfade processing with both EDLs and PALs. The contribution of EDLs and PALs was balanced to better synthesize the target sound field. We carried out experiments to evaluate the sound pressure, frequency characteristic, and sound image perception. The experimental results demonstrated that the proposed method can enhance these aspects of the VSS.
- 19 December 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (24) , 11911
Open AccessEnhanced Virtual Sound Source Construction Based on Wave Field Synthesis Using Crossfade Processing with Electro-Dynamic and Parametric Loudspeaker Arrays
Wave field synthesis (WFS) can be used to construct virtual sound sources (VSSs) with a loudspeaker array. Conventional methods using a single type of loudspeaker showed limited performance in distance perception. For example, WFS with electro-dynamic loudspeakers (EDLs) has the advantage of constructing VSSs near the loudspeaker, while WFS with parametric array loudspeakers (PALs) has the advantage of constructing VSSs far from the loudspeaker. In this paper, we propose a VSS construction method utilizing crossfade processing with both EDLs and PALs. The contribution of EDLs and PALs was balanced to better synthesize the target sound field. We carried out experiments to evaluate the sound pressure, frequency characteristic, and sound image perception. The experimental results demonstrated that the proposed method can enhance these aspects of the VSS.
- Open Access
- 13 November 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (22) , 10467
Comfortable Sound Design Based on Auditory Masking with Chord Progression and Melody Generation Corresponding to the Peak Frequencies of Dental Treatment Noises
Noise reduction methods have been proposed for various loud noises. However, in a quiet indoor environment, even small noises often cause discomfort. One of the small noises that causes discomfort is noise with resonant frequencies. Since resonant frequencies are often high frequencies, it is difficult to apply conventional active noise control methods to them. To solve this problem, we focused on auditory masking, a phenomenon in which synthesized sounds increase the audible threshold. We have performed several studies on reducing discomfort based on auditory masking. However, it was difficult for comfortable sound design to be achieved using the previously proposed methods, even though they were able to reduce feelings of discomfort. Here, we focus on a pleasant sound: music. Comfortable sound design is made possible by introducing music theory into the design of masker signals. In this paper, we therefore propose comfortable sound design based on auditory masking with chord progression and melody generation to match the peak frequencies of dental treatment noises.
- 13 November 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (22) , 10467
Open AccessComfortable Sound Design Based on Auditory Masking with Chord Progression and Melody Generation Corresponding to the Peak Frequencies of Dental Treatment Noises
Noise reduction methods have been proposed for various loud noises. However, in a quiet indoor environment, even small noises often cause discomfort. One of the small noises that causes discomfort is noise with resonant frequencies. Since resonant frequencies are often high frequencies, it is difficult to apply conventional active noise control methods to them. To solve this problem, we focused on auditory masking, a phenomenon in which synthesized sounds increase the audible threshold. We have performed several studies on reducing discomfort based on auditory masking. However, it was difficult for comfortable sound design to be achieved using the previously proposed methods, even though they were able to reduce feelings of discomfort. Here, we focus on a pleasant sound: music. Comfortable sound design is made possible by introducing music theory into the design of masker signals. In this paper, we therefore propose comfortable sound design based on auditory masking with chord progression and melody generation to match the peak frequencies of dental treatment noises.
- Open Access
- 1 November 2024
- Published by Research Institute of Signal Processing, Japan in Journal of Signal Processing
- Vol. 28  (6) , 267-275
Sound-Field Reproduction Based on Virtual Early Reflections Using Parametric and Electrodynamic Loudspeakers
Highly realistic sound-field reproduction systems have been attracting attention owing to their ability to reproduce a sound field. These systems commonly use electrodynamic loudspeakers (EDLs) to construct sound images. The directivity of EDLs is broad, so the constructed sound images become diffused owing to the reverberation characteristics of the room. Therefore, sharp sound-image construction requires a large, complex system. As a more feasible approach, we focus on parametric array loudspeakers (PALs). The directivity of PALs is narrow, so the constructed sound image is sharp. Therefore, we propose a sound-field reproduction system that involves using a PAL to construct a sharp sound image and EDLs to reproduce the sensation of reverberation. To reproduce the sensation of reverberation, the early reflections of the target sound field are calculated using the mirror-image method, and virtual early reflections are produced. Thus, the sharpness of the sound image and the sensation of reverberation can be easily controlled to reproduce a highly realistic sound field. We conducted objective evaluation experiments to verify the effectiveness of the proposed system.
- 1 November 2024
- Published by Research Institute of Signal Processing, Japan in Journal of Signal Processing
- Vol. 28  (6) , 267-275
Open AccessSound-Field Reproduction Based on Virtual Early Reflections Using Parametric and Electrodynamic Loudspeakers
Highly realistic sound-field reproduction systems have been attracting attention owing to their ability to reproduce a sound field. These systems commonly use electrodynamic loudspeakers (EDLs) to construct sound images. The directivity of EDLs is broad, so the constructed sound images become diffused owing to the reverberation characteristics of the room. Therefore, sharp sound-image construction requires a large, complex system. As a more feasible approach, we focus on parametric array loudspeakers (PALs). The directivity of PALs is narrow, so the constructed sound image is sharp. Therefore, we propose a sound-field reproduction system that involves using a PAL to construct a sharp sound image and EDLs to reproduce the sensation of reverberation. To reproduce the sensation of reverberation, the early reflections of the target sound field are calculated using the mirror-image method, and virtual early reflections are produced. Thus, the sharpness of the sound image and the sensation of reverberation can be easily controlled to reproduce a highly realistic sound field. We conducted objective evaluation experiments to verify the effectiveness of the proposed system.
- Open Access
- 17 June 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (12) , 5241
Visualization of Demodulated Sound Based on Sequential Acoustic Ray Tracing with Self-Demodulation in Parametric Array Loudspeakers
With the development of acoustic simulation methods in recent decades, it has become feasible to simulate the sound pressure distribution of loudspeakers before actually setting physical speakers and measuring the sound field. The parametric array loudspeaker (PAL) has attracted attention due to its sharp directivity and unique applications. However, the sound reproduced by PALs is generated by the nonlinear interactions of ultrasound in the air, which makes it difficult to simulate the reproduced sound of a PAL with low computational load. Focusing on the sharp directivity of ultrasound, we extended conventional acoustic ray-tracing methods to consider the self-demodulation phenomenon of PALs. In this study, we developed a visualization method for the demodulated sound of a PAL. Specifically, the demodulated sound pressure distribution can be simulated to estimate and visualize the area covered by the reproduced sound of PAL before setting a real PAL. In the proposed method, acoustic rays were generated sequentially to express the generation of demodulated sound. Therefore, the proposed method is expected to simulate the demodulated sound of a PAL with acceptable accuracy and low calculation complexity. Quantitative evaluation between simulation results and practical measurement has been carried out, and the results demonstrate the effectiveness of the proposed method.
- 17 June 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14  (12) , 5241
Open AccessVisualization of Demodulated Sound Based on Sequential Acoustic Ray Tracing with Self-Demodulation in Parametric Array Loudspeakers
With the development of acoustic simulation methods in recent decades, it has become feasible to simulate the sound pressure distribution of loudspeakers before actually setting physical speakers and measuring the sound field. The parametric array loudspeaker (PAL) has attracted attention due to its sharp directivity and unique applications. However, the sound reproduced by PALs is generated by the nonlinear interactions of ultrasound in the air, which makes it difficult to simulate the reproduced sound of a PAL with low computational load. Focusing on the sharp directivity of ultrasound, we extended conventional acoustic ray-tracing methods to consider the self-demodulation phenomenon of PALs. In this study, we developed a visualization method for the demodulated sound of a PAL. Specifically, the demodulated sound pressure distribution can be simulated to estimate and visualize the area covered by the reproduced sound of PAL before setting a real PAL. In the proposed method, acoustic rays were generated sequentially to express the generation of demodulated sound. Therefore, the proposed method is expected to simulate the demodulated sound of a PAL with acceptable accuracy and low calculation complexity. Quantitative evaluation between simulation results and practical measurement has been carried out, and the results demonstrate the effectiveness of the proposed method.
- 31 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2287-2293
Narrow-edged Acoustical Beamforming Utilizing Phase Inversion for Frequency Modulation-based Parametric Array Loudspeaker
Parametric array loudspeakers (PALs) can achieve narrow directivity with the straightness of ultrasonic waves. However, the acoustic beam formed by small-scale PALs has a tendency to spread easily. We have previously proposed a narrow-edged beamforming based on phase inversion for common amplitude modulation-based PALs; however, it decreased the sound pressure significantly when forming a narrow acoustic beam. In this study, we focus on frequency modulation-based PALs, in which a modulated wave has a constant envelope and can hold more energy in a limited amplitude. The phase inversion strategy is discussed to use phase cancellation in both ultrasound and audible sound for a narrow beam. The experimental results show that the proposed method can achieve narrow-edged acoustical beam while reducing the decrease in sound pressure.
- 31 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2287-2293
Narrow-edged Acoustical Beamforming Utilizing Phase Inversion for Frequency Modulation-based Parametric Array Loudspeaker
Parametric array loudspeakers (PALs) can achieve narrow directivity with the straightness of ultrasonic waves. However, the acoustic beam formed by small-scale PALs has a tendency to spread easily. We have previously proposed a narrow-edged beamforming based on phase inversion for common amplitude modulation-based PALs; however, it decreased the sound pressure significantly when forming a narrow acoustic beam. In this study, we focus on frequency modulation-based PALs, in which a modulated wave has a constant envelope and can hold more energy in a limited amplitude. The phase inversion strategy is discussed to use phase cancellation in both ultrasound and audible sound for a narrow beam. The experimental results show that the proposed method can achieve narrow-edged acoustical beam while reducing the decrease in sound pressure.