Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Masato Nakayama has a total of 47 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Acoustic Metadata Design on Object-Based Audio Using Estimated 3D-Position from Visual Image Toward Depth-Directional Sound Image Localization

    by Subaru Kato, Masato Nakayama, Takanobu Nishiura, Yoshiharu Soeta

    Multichannel audio is a sound field reproduction technology that uses multiple loudspeakers. Object-based audio is a playback method for multichannel audio that enables the construction of sound images at specified positions using coordinates within the playback space. However, the sound image positions must be manually specified by audio content creators, which increases the production workload, especially for works containing many sound images or feature films. We have previously proposed a method to reduce the workload of content creators by constructing sound images based on object positions in visual images. However, a significant challenge remains since depth localization of the sound image is not accurate enough. This paper aims to improve localization accuracy by changing the range of sound image movement along the depth direction. To confirm the localization accuracy of sound images constructed using the proposed method, we conducted a subjective evaluation experiment. The experiment identified the optimal movement range by presenting participants with visual images synchronized with sound images moving across varying spatial scales. Consequently, we were able to identify the range of sound image movement in the depth direction necessary for presenting sound images with high consistency with the visual images.

  • Open Access

    Head Orientation Estimation Based on Multiple Frequency Bands Using Sparsely Aligned Microphones

    by Toru Takahashi, Taiki Kanbayashi, Ryota Aoki, Yuta Ochi, Akira Lee, Masato Nakayama

    We describe the problem of estimating the speaker’s head orientation from the asynchronous multi-channel waveforms observed by microphones distributed in a room. In particular, we address a novel problem of estimating head orientation from sound captured by fewer microphones than the number of distinct head orientations to be distinguished. This is because the head orientation is an important clue indicating the speaker’s intended conversational partners. Head orientation estimation technology is an essential technology within environmental intelligence technology, which uses sensors embedded in rooms to monitor and support people’s activities. We propose a head orientation estimation method that aims to achieve high angular resolution using a small number of microphones. The proposed method achieves high estimation accuracy by using the spatial radiation pattern of the sound source as clues and by integrating information from multiple frequency bands. We conducted an experiment to estimate head orientation with an angular resolution of 15degrees under observation conditions using six microphones. Experimental results showed that higher estimation accuracy was obtained than the conventional method using distributed microphone arrays (Oriented Global Coherence Field method) and the conventional method using distributed microphones (Radiation Pattern Matching method). The proposed method utilizing multiple frequency bands achieved the best performance with a mean absolute error of 10.58degrees in the task of classifying 24 distinct head orientations.

  • Open Access

    Virtual Sound Source Construction Based on Direct-to-Reverberant Ratio Control Using Multiple Pairs of Parametric-Array Loudspeakers and Conventional Loudspeakers

    by Masato Nakayama, Takuma Ekawa, Toru Takahashi, Takanobu Nishiura

    We propose a new method for constructing a virtual sound source (VSS) based on the direct-to-reverberant ratio (DRR) of room impulse responses (RIRs), using multiple pairs of parametric-array loudspeakers (PALs) and conventional loudspeakers (hereafter referred to simply as loudspeakers). In this paper, we focus on the differences in the DRRs of the RIRs generated by PALs and loudspeakers. The DRR of an RIR is recognized as a key cue for distance perception. A PAL can achieve super-directivity using an array of ultrasonic transducers. Its RIR exhibits a high DRR, characterized by a large-amplitude direct wave and low-amplitude reverberations. Consequently, a PAL makes the VSS appear to be closer to the listener. In contrast, a loudspeaker causes the VSS to be perceived as farther away because the sound it emits has a low DRR. The proposed method leverages the differences in the DRRs of the RIRs between PALs and loudspeakers. It controls the perceived distance of the VSS by reproducing the desired DRR at the listener’s position through a weighted combination of the RIRs emitted from PALs and loudspeakers into the air. Additionally, the proposed method adjusts the direction of the VSS using vector-based amplitude panning (VBAP). Finally, we have confirmed the effectiveness of the proposed method through evaluation experiments.


  • Open Access

    Simultaneous Localization of Two Talkers Placed in an Area Surrounded by Asynchronous Six-Microphone Arrays

    by Toru Takahashi, Taiki Kanbayashi, Masato Nakayama

    If we can understand dialogue activities, it will be possible to know the role of each person in the discussion, and it will be possible to provide basic materials for formulating facilitation strategies. This understanding can be expected to be used for business negotiations, group work, active learning, etc. To develop a system that can monitor speech activity over a wide range of areas, we propose a method for detecting multiple acoustic events and localizing sound sources using an asynchronous distributed microphone array arranged in a regular hexagonal repeating structure. In contrast to conventional methods based on sound source direction using triangulation with microphone arrays, we propose a method for detecting acoustic events and determining sound sources from local maximum positions based on estimation of the spatial energy distribution inside the observation space. We evaluated the conventional method and the proposed method in an experimental environment in which a dialogue between two people was simulated under 22,104 conditions by using the sound source signal convolving the measured impulse response.We found that the performance changes depending on the selection of the microphone array used for estimation. Our finding is that it is best to choose five microphone arrays close to the evaluation position.


  • Open Access

    Multichannel feedforward active noise control system with an optical laser microphone and a distant air-conduction microphone for noise reduction in a real system

    by Maoto Mizutani, Kenta Iwai, Masato Nakayama, Takanobu Nishiura, Yoshiharu Soeta

    A conventional feedforward active noise control system suffers from degraded performance of noise reduction due to the causality constraint caused by processing and propagation delays. To address this issue, we propose a multichannel feedforward active noise control system that combines an optical laser microphone and an air-conduction microphone. The proposed system relaxes the causality constraint by acquiring vibration information at the speed of light using the optical laser microphone and enhances coherence using the signal of the air-conduction microphone. Experiments using a laser Doppler vibrometer and an electret condenser microphone demonstrate superior noise reduction compared to the conventional system.

  • Open Access

    Enhanced Virtual Sound Source Construction Based on Wave Field Synthesis Using Crossfade Processing with Electro-Dynamic and Parametric Loudspeaker Arrays

    by Yuting Geng, Ayano Hirose, Mizuki Iwagami, Masato Nakayama, Takanobu Nishiura

    Wave field synthesis (WFS) can be used to construct virtual sound sources (VSSs) with a loudspeaker array. Conventional methods using a single type of loudspeaker showed limited performance in distance perception. For example, WFS with electro-dynamic loudspeakers (EDLs) has the advantage of constructing VSSs near the loudspeaker, while WFS with parametric array loudspeakers (PALs) has the advantage of constructing VSSs far from the loudspeaker. In this paper, we propose a VSS construction method utilizing crossfade processing with both EDLs and PALs. The contribution of EDLs and PALs was balanced to better synthesize the target sound field. We carried out experiments to evaluate the sound pressure, frequency characteristic, and sound image perception. The experimental results demonstrated that the proposed method can enhance these aspects of the VSS.


  • Open Access

    Comfortable Sound Design Based on Auditory Masking with Chord Progression and Melody Generation Corresponding to the Peak Frequencies of Dental Treatment Noises

    by Masato Nakayama, Takuya Hayashi, Toru Takahashi, Takanobu Nishiura

    Noise reduction methods have been proposed for various loud noises. However, in a quiet indoor environment, even small noises often cause discomfort. One of the small noises that causes discomfort is noise with resonant frequencies. Since resonant frequencies are often high frequencies, it is difficult to apply conventional active noise control methods to them. To solve this problem, we focused on auditory masking, a phenomenon in which synthesized sounds increase the audible threshold. We have performed several studies on reducing discomfort based on auditory masking. However, it was difficult for comfortable sound design to be achieved using the previously proposed methods, even though they were able to reduce feelings of discomfort. Here, we focus on a pleasant sound: music. Comfortable sound design is made possible by introducing music theory into the design of masker signals. In this paper, we therefore propose comfortable sound design based on auditory masking with chord progression and melody generation to match the peak frequencies of dental treatment noises.


  • Open Access

    Sound-Field Reproduction Based on Virtual Early Reflections Using Parametric and Electrodynamic Loudspeakers

    by Yoto Ikezaki, Yuna Harada, Yuting Geng, Masato Nakayama, Takanobu Nishiura

    Highly realistic sound-field reproduction systems have been attracting attention owing to their ability to reproduce a sound field. These systems commonly use electrodynamic loudspeakers (EDLs) to construct sound images. The directivity of EDLs is broad, so the constructed sound images become diffused owing to the reverberation characteristics of the room. Therefore, sharp sound-image construction requires a large, complex system. As a more feasible approach, we focus on parametric array loudspeakers (PALs). The directivity of PALs is narrow, so the constructed sound image is sharp. Therefore, we propose a sound-field reproduction system that involves using a PAL to construct a sharp sound image and EDLs to reproduce the sensation of reverberation. To reproduce the sensation of reverberation, the early reflections of the target sound field are calculated using the mirror-image method, and virtual early reflections are produced. Thus, the sharpness of the sound image and the sensation of reverberation can be easily controlled to reproduce a highly realistic sound field. We conducted objective evaluation experiments to verify the effectiveness of the proposed system.

  • Open Access

    Visualization of Demodulated Sound Based on Sequential Acoustic Ray Tracing with Self-Demodulation in Parametric Array Loudspeakers

    by Yuting Geng, Makoto Shimokata, Masato Nakayama, Takanobu Nishiura

    With the development of acoustic simulation methods in recent decades, it has become feasible to simulate the sound pressure distribution of loudspeakers before actually setting physical speakers and measuring the sound field. The parametric array loudspeaker (PAL) has attracted attention due to its sharp directivity and unique applications. However, the sound reproduced by PALs is generated by the nonlinear interactions of ultrasound in the air, which makes it difficult to simulate the reproduced sound of a PAL with low computational load. Focusing on the sharp directivity of ultrasound, we extended conventional acoustic ray-tracing methods to consider the self-demodulation phenomenon of PALs. In this study, we developed a visualization method for the demodulated sound of a PAL. Specifically, the demodulated sound pressure distribution can be simulated to estimate and visualize the area covered by the reproduced sound of PAL before setting a real PAL. In the proposed method, acoustic rays were generated sequentially to express the generation of demodulated sound. Therefore, the proposed method is expected to simulate the demodulated sound of a PAL with acceptable accuracy and low calculation complexity. Quantitative evaluation between simulation results and practical measurement has been carried out, and the results demonstrate the effectiveness of the proposed method.


  • Narrow-edged Acoustical Beamforming Utilizing Phase Inversion for Frequency Modulation-based Parametric Array Loudspeaker

    by Yuting Geng, Masato Nakayama, Takanobu Nishiura

    Parametric array loudspeakers (PALs) can achieve narrow directivity with the straightness of ultrasonic waves. However, the acoustic beam formed by small-scale PALs has a tendency to spread easily. We have previously proposed a narrow-edged beamforming based on phase inversion for common amplitude modulation-based PALs; however, it decreased the sound pressure significantly when forming a narrow acoustic beam. In this study, we focus on frequency modulation-based PALs, in which a modulated wave has a constant envelope and can hold more energy in a limited amplitude. The phase inversion strategy is discussed to use phase cancellation in both ultrasound and audible sound for a narrow beam. The experimental results show that the proposed method can achieve narrow-edged acoustical beam while reducing the decrease in sound pressure.