Giso Grimm
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Giso Grimm has a total of 63 co-authors. Here are the top co-authors by number of shared publications:
Volker Hohmann
Dept. of Medical Phys. and Acoust., Carl von Ossietzky Universitaet, Oldenburg, Germany
14 shared publications- Volker Hohmann
University of Oldenburg
8 shared publications - Tobias Neher
Department of Clinical Research, University of Southern Denmark
6 shared publications - Birger Kollmeier
Medizinische Physik, Carl von Ossietzky Universität Oldenburg, 26129 Oldenburg, Germany
5 shared publications Birger Kollmeier
Carl-von-Ossietzky Universität, Oldenburg, Dept. Medical Physics and Acoustics, Cluster of Excellence “Hearing4all”, Carl-von-Ossietzky-Str. 9–11, 26129 Oldenburg, Germany
3 shared publications- Angelika Kothe
Carl von Ossietzky Universität Oldenburg
2 shared publications
Latest Publications
- Open Access
- 29 July 2026
- Published by University of California Press in Music Perception: An Interdisciplinary Journal
- p. 1-17
Investigating Instrument Identification in a Virtual Orchestral Scene
Musical scene analysis (MSA) in an orchestral context is affected by the spatial positioning of instruments on stage, the reverberation of the concert hall, and the musical structure itself. Although studies have investigated the perceptual blending of instruments in musical mixtures, instrument identification has mostly been studied for sounds in isolation. How the acoustic and musical variables affect identification performance remains unclear. In the present study we used a cue-mixture identification paradigm to have participants identify eight sustained instruments in twelve short four-instrument mixtures taken from Wagner’s Tristan prelude. Excerpts were rendered with and without concert hall acoustics using a room-acoustic modeling software with instruments either spread out on stage or all in a single center location. Against initial hypotheses, reverberation of the virtual concert hall and spatial distribution of instruments did not affect identification performance, despite clear effects on sound quality ratings. On the other hand, instrument-dependent musical effects of voice, register, and acoustical content were observed. These results hint at instrument identification performance showing robustness to variations in acoustic conditions and highlight the complex nature of instrument perception in realistic sound mixtures.
- 29 July 2026
- Published by University of California Press in Music Perception: An Interdisciplinary Journal
- p. 1-17
Open AccessInvestigating Instrument Identification in a Virtual Orchestral Scene
Musical scene analysis (MSA) in an orchestral context is affected by the spatial positioning of instruments on stage, the reverberation of the concert hall, and the musical structure itself. Although studies have investigated the perceptual blending of instruments in musical mixtures, instrument identification has mostly been studied for sounds in isolation. How the acoustic and musical variables affect identification performance remains unclear. In the present study we used a cue-mixture identification paradigm to have participants identify eight sustained instruments in twelve short four-instrument mixtures taken from Wagner’s Tristan prelude. Excerpts were rendered with and without concert hall acoustics using a room-acoustic modeling software with instruments either spread out on stage or all in a single center location. Against initial hypotheses, reverberation of the virtual concert hall and spatial distribution of instruments did not affect identification performance, despite clear effects on sound quality ratings. On the other hand, instrument-dependent musical effects of voice, register, and acoustical content were observed. These results hint at instrument identification performance showing robustness to variations in acoustic conditions and highlight the complex nature of instrument perception in realistic sound mixtures.
- Open Access
- 4 June 2026
- Published by Elsevier in Data in Brief
- Vol. 67, 112932
Dataset of audiovisual unscripted monologues with speech annotations
- 4 June 2026
- Published by Elsevier in Data in Brief
- Vol. 67, 112932
Open AccessDataset of audiovisual unscripted monologues with speech annotations
- Open Access
- 1 January 2026
- Published by SAGE Publications in Trends in Hearing
- Vol. 30
Interaction Between Head Movement Behavior and Simulated Spatial Filtering: Comparing Free Conversation and Speech Tests in Virtual Reality
The benefit provided by hearing devices often differs between laboratory evaluations and real-world conditions, due to low signal-to-noise ratio (SNR) in adaptive speech tests and differences in head movement behavior between laboratory evaluations and real conversations. This study aimed to investigate whether SNR improvement provided by a spatial filter can be measured during free conversation in virtual reality (VR) and to compare this SNR improvement with the benefit measured using a speech test with two spatially separated talkers in the same VR. Two experimental conditions were tested in 11 normal-hearing participants. Condition 1 involved free conversations between a participant and two confederates represented by avatars, and Condition 2 utilized an adaptive speech test with two speakers, presented by the same avatars. Acoustic simulations were used to render speech signals, background noise and room acoustics. A spatial filter with two levels of selectivity was simulated in VR using the participant’s actual dynamic head orientation. Acoustic measures of the benefit of the spatial filter were derived from these simulated signals. The benefit was higher when measured in free conversations than in the speech test. Additionally, participants were found to move their heads closer to active speakers during free conversation than during the speech test. Furthermore, SNR in free conversations was closer to SNRs typical of conversational environments. These findings suggest that the effectiveness of hearing devices can be evaluated through conversations in VR at more realistic SNRs. Consequently, this approach may improve the ecological validity of hearing aid research outcomes.
- 1 January 2026
- Published by SAGE Publications in Trends in Hearing
- Vol. 30
Open AccessInteraction Between Head Movement Behavior and Simulated Spatial Filtering: Comparing Free Conversation and Speech Tests in Virtual Reality
The benefit provided by hearing devices often differs between laboratory evaluations and real-world conditions, due to low signal-to-noise ratio (SNR) in adaptive speech tests and differences in head movement behavior between laboratory evaluations and real conversations. This study aimed to investigate whether SNR improvement provided by a spatial filter can be measured during free conversation in virtual reality (VR) and to compare this SNR improvement with the benefit measured using a speech test with two spatially separated talkers in the same VR. Two experimental conditions were tested in 11 normal-hearing participants. Condition 1 involved free conversations between a participant and two confederates represented by avatars, and Condition 2 utilized an adaptive speech test with two speakers, presented by the same avatars. Acoustic simulations were used to render speech signals, background noise and room acoustics. A spatial filter with two levels of selectivity was simulated in VR using the participant’s actual dynamic head orientation. Acoustic measures of the benefit of the spatial filter were derived from these simulated signals. The benefit was higher when measured in free conversations than in the speech test. Additionally, participants were found to move their heads closer to active speakers during free conversation than during the speech test. Furthermore, SNR in free conversations was closer to SNRs typical of conversational environments. These findings suggest that the effectiveness of hearing devices can be evaluated through conversations in VR at more realistic SNRs. Consequently, this approach may improve the ecological validity of hearing aid research outcomes.
- Open Access
- 1 January 2026
- Published by SAGE Publications in Trends in Hearing
- Vol. 30
Effect of Avatar Head Movements on Communication Behavior and Subjective Evaluations of Presence and Success in Triadic Conversations
Interactive communication in virtual reality can be used in experimental paradigms to increase the ecological validity of hearing device evaluations. This requires the virtual environment to elicit natural communication behavior in listeners. This study evaluates the effect of virtual animated characters’ head movements on participants’ communication behavior and experience. Triadic conversations were conducted between a study participant and two confederates. To facilitate the manipulation of head movements, the conversation was conducted in telepresence using a system that transmitted audio, head movement data and video with low delay. The confederates were represented by virtual animated characters (avatars) with different levels of animation: Static heads, automated head movement animations based on speech level onsets, and animated head movements based on the transmitted head movements of the confederates. A condition was also included in which the live videos of the confederates’ heads were embedded in the visual scene. Sixteen young adults (19–32 years) with self-reported normal hearing participated in the study, i.e., 16 triads were measured. The results show significant effects of animation level on the participants’ speech and head movement behavior as recorded by physical sensors, as well as on the subjective experience. The largest effects were found for the range of head orientation while speaking, the head orientation while listening, and the perceived realism of avatars. We therefore conclude that the representation of conversation partners affects communication behavior, which may be considered when natural speech and movement behavior is desired.
- 1 January 2026
- Published by SAGE Publications in Trends in Hearing
- Vol. 30
Open AccessEffect of Avatar Head Movements on Communication Behavior and Subjective Evaluations of Presence and Success in Triadic Conversations
Interactive communication in virtual reality can be used in experimental paradigms to increase the ecological validity of hearing device evaluations. This requires the virtual environment to elicit natural communication behavior in listeners. This study evaluates the effect of virtual animated characters’ head movements on participants’ communication behavior and experience. Triadic conversations were conducted between a study participant and two confederates. To facilitate the manipulation of head movements, the conversation was conducted in telepresence using a system that transmitted audio, head movement data and video with low delay. The confederates were represented by virtual animated characters (avatars) with different levels of animation: Static heads, automated head movement animations based on speech level onsets, and animated head movements based on the transmitted head movements of the confederates. A condition was also included in which the live videos of the confederates’ heads were embedded in the visual scene. Sixteen young adults (19–32 years) with self-reported normal hearing participated in the study, i.e., 16 triads were measured. The results show significant effects of animation level on the participants’ speech and head movement behavior as recorded by physical sensors, as well as on the subjective experience. The largest effects were found for the range of head orientation while speaking, the head orientation while listening, and the perceived realism of avatars. We therefore conclude that the representation of conversation partners affects communication behavior, which may be considered when natural speech and movement behavior is desired.
- 27 June 2025
- Published by Springer Nature
- p. 105-125
Hörstörungen und Hörgeräte
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
EEG Hyperscanning in the Internet of Sounds: Low-Delay Real-Time Multi-Modal Transmission Using the OVBOX
The OVBOX (ORLANDOviols consort box) is a tool for immersive network audio transmission with low delay and interactive spatial rendering on each client. In this paper, we demonstrate its extension to the transmission of electroen-cephalography (EEG) signals, which forms the basis for low-delay hyperscanning in telepresence scenarios. In addition to microphone signals, motion data, EEG signals and any other data can be exchanged in the Open Sound Control (OSC) or Lab Streaming Layer (LSL) protocol. This makes it possible to analyse several modalities simultaneously over the Internet. The methods used are described, a performance analysis and example hyperscanning data of a motor/audio task are presented.
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
EEG Hyperscanning in the Internet of Sounds: Low-Delay Real-Time Multi-Modal Transmission Using the OVBOX
The OVBOX (ORLANDOviols consort box) is a tool for immersive network audio transmission with low delay and interactive spatial rendering on each client. In this paper, we demonstrate its extension to the transmission of electroen-cephalography (EEG) signals, which forms the basis for low-delay hyperscanning in telepresence scenarios. In addition to microphone signals, motion data, EEG signals and any other data can be exchanged in the Open Sound Control (OSC) or Lab Streaming Layer (LSL) protocol. This makes it possible to analyse several modalities simultaneously over the Internet. The methods used are described, a performance analysis and example hyperscanning data of a motor/audio task are presented.
- Open Access
- 11 April 2024
- Published by EDP Sciences in Acta Acustica
- Vol. 8, 18
Interactive low delay music and speech communication via network connections (OVBOX)
The “OVBOX” is a tool for low-delay network audio communication and generic data transmission between multiple clients. Acoustic end-to-end delays of about 30 ms can be achieved, assuming a good internet connection and a distance between clients of less than about 1500 km. For optimal spatial perception, e.g., when using multiple instruments of similar timbre, an individual 3-dimensional room acoustic simulation based on physical modelling is applied in each client. The system is optimised for headless operation using a dedicated single-board computer (Raspberry Pi 4B), but desktop clients are also available for better integration with other audio software. A client-server system allows remote configuration and automatic traversal of network address translation routers and firewalls. With the low latency that can be achieved, the “OVBOX” is used for music applications such as distributed rehearsals or concerts. Other applications include hearing research to achieve interactive speech communication with low delay transmission of head movements for real-time control of virtual reality, and transmission of other biophysical data for online analysis or central data logging. The tool is fully open source.
- 11 April 2024
- Published by EDP Sciences in Acta Acustica
- Vol. 8, 18
Open AccessInteractive low delay music and speech communication via network connections (OVBOX)
The “OVBOX” is a tool for low-delay network audio communication and generic data transmission between multiple clients. Acoustic end-to-end delays of about 30 ms can be achieved, assuming a good internet connection and a distance between clients of less than about 1500 km. For optimal spatial perception, e.g., when using multiple instruments of similar timbre, an individual 3-dimensional room acoustic simulation based on physical modelling is applied in each client. The system is optimised for headless operation using a dedicated single-board computer (Raspberry Pi 4B), but desktop clients are also available for better integration with other audio software. A client-server system allows remote configuration and automatic traversal of network address translation routers and firewalls. With the low latency that can be achieved, the “OVBOX” is used for music applications such as distributed rehearsals or concerts. Other applications include hearing research to achieve interactive speech communication with low delay transmission of head movements for real-time control of virtual reality, and transmission of other biophysical data for online analysis or central data logging. The tool is fully open source.
- Open Access
- 1 April 2024
- Published by EDP Sciences in Acta Acustica
- Vol. 8, 17
Comparison of 2D and 3D multichannel audio rendering methods for hearing research applications using technical and perceptual measures
Virtual reality with multichannel audio playback is increasingly used in hearing aid research. The purpose of this study is to compare horizontal (2D) and periphonic (3D) rendering methods in terms of localization, minimum audible angle, and perceptual ratings related to spatial quality. Higher Order Ambisonics, Vector-Base Amplitude Panning, and Nearest Speaker Selection were used, with playback through 16, 29 and 45 speakers. The results show that an improvement in vertical localization can be obtained by using periphonic rendering instead of horizontal rendering. The perceptual advantage of periphonic rendering depends on the spatial complexity of the scene; it disappears in complex acoustic environments. Scenes with low acoustic complexity, such as a single primary sound source in a room, benefit from Nearest Speaker Selection rendering. For more complex scenes with multiple sound sources, such as a symphony orchestra in a concert hall with many primary sources, or traffic on a road with moving sources, horizontal rendering methods such as 2D Higher Order Ambisonics will provide similar or better performance.
- 1 April 2024
- Published by EDP Sciences in Acta Acustica
- Vol. 8, 17
Open AccessComparison of 2D and 3D multichannel audio rendering methods for hearing research applications using technical and perceptual measures
Virtual reality with multichannel audio playback is increasingly used in hearing aid research. The purpose of this study is to compare horizontal (2D) and periphonic (3D) rendering methods in terms of localization, minimum audible angle, and perceptual ratings related to spatial quality. Higher Order Ambisonics, Vector-Base Amplitude Panning, and Nearest Speaker Selection were used, with playback through 16, 29 and 45 speakers. The results show that an improvement in vertical localization can be obtained by using periphonic rendering instead of horizontal rendering. The perceptual advantage of periphonic rendering depends on the spatial complexity of the scene; it disappears in complex acoustic environments. Scenes with low acoustic complexity, such as a single primary sound source in a room, benefit from Nearest Speaker Selection rendering. For more complex scenes with multiple sound sources, such as a symphony orchestra in a concert hall with many primary sources, or traffic on a road with moving sources, horizontal rendering methods such as 2D Higher Order Ambisonics will provide similar or better performance.
- Open Access
- 1 March 2023
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 153 (3_suppleme) , A36
Low-delay interactive rendering of virtual acoustic environments with extensions for distributed low-delay transmission of audio and bio-physical sensor data
In this study, we present a system that enables low-delay rendering of interactive virtual acoustics. The tool operates in the time domain based on a physical sound propagation model with basic room acoustic modelling and a block-wise update and interpolation of the environment geometry. During the pandemic, the tool was extended by low-delay network-transmission of audio and sensor data, e.g., from motion sensors or bio-physical sensors such as EEG. With this extension, distributed rendering of turn-taking conversations as well as ensemble music performances with individual head-tracked binaural rendering and interactive movement of directional sources is possible. Interactive communication requires a low time delay in sound transmission, which is particularly critical for musical communication, where the upper limit of tolerable delay is between 30 and 50 ms, depending on the genre. Our system can achieve latencies between 7 (dedicated local network) and 100 ms (intercontinental connection), with typical values of 25–40 ms. This is far below the delay achieved by typical video-conferencing tools and is sufficient for fluent speech communicationand music applications. In addition to a technical description of the system, we show here example measurement data of head motion behaviour in a distributed triadic conversation.
- 1 March 2023
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 153 (3_suppleme) , A36
Open AccessLow-delay interactive rendering of virtual acoustic environments with extensions for distributed low-delay transmission of audio and bio-physical sensor data
In this study, we present a system that enables low-delay rendering of interactive virtual acoustics. The tool operates in the time domain based on a physical sound propagation model with basic room acoustic modelling and a block-wise update and interpolation of the environment geometry. During the pandemic, the tool was extended by low-delay network-transmission of audio and sensor data, e.g., from motion sensors or bio-physical sensors such as EEG. With this extension, distributed rendering of turn-taking conversations as well as ensemble music performances with individual head-tracked binaural rendering and interactive movement of directional sources is possible. Interactive communication requires a low time delay in sound transmission, which is particularly critical for musical communication, where the upper limit of tolerable delay is between 30 and 50 ms, depending on the genre. Our system can achieve latencies between 7 (dedicated local network) and 100 ms (intercontinental connection), with typical values of 25–40 ms. This is far below the delay achieved by typical video-conferencing tools and is sufficient for fluent speech communicationand music applications. In addition to a technical description of the system, we show here example measurement data of head motion behaviour in a distributed triadic conversation.
- Open Access
- 29 November 2022
- Published by EDP Sciences in Acta Acustica
- Vol. 6, 55
Auditory-visual scenes for hearing research
While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-life situations as well as for developing and evaluating increasingly sophisticated algorithms for hearing assistance. A range of ‘classical’ stimuli and paradigms have evolved to de-facto standards in psychoacoustics, which are simplistic and can be easily reproduced across laboratories. While they ideally allow for across laboratory comparisons and reproducible research, they, however, lack the acoustic stimulus complexity and the availability of visual information as observed in everyday life communication and listening situations. This contribution aims to provide and establish an extendable set of complex auditory-visual scenes for hearing research that allow for ecologically valid testing in realistic scenes while also supporting reproducibility and comparability of scientific results. Three virtual environments are provided (underground station, pub, living room), consisting of a detailed visual model, an acoustic geometry model with acoustic surface properties as well as a set of acoustic measurements in the respective real-world environments. The current data set enables i) audio–visual research in a reproducible set of environments, ii) comparison of room acoustic simulation methods with “ground truth” acoustic measurements, iii) a condensation point for future extensions and contributions for developments towards standardized test cases for ecologically valid hearing research in complex scenes.
- 29 November 2022
- Published by EDP Sciences in Acta Acustica
- Vol. 6, 55
Open AccessAuditory-visual scenes for hearing research
While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-life situations as well as for developing and evaluating increasingly sophisticated algorithms for hearing assistance. A range of ‘classical’ stimuli and paradigms have evolved to de-facto standards in psychoacoustics, which are simplistic and can be easily reproduced across laboratories. While they ideally allow for across laboratory comparisons and reproducible research, they, however, lack the acoustic stimulus complexity and the availability of visual information as observed in everyday life communication and listening situations. This contribution aims to provide and establish an extendable set of complex auditory-visual scenes for hearing research that allow for ecologically valid testing in realistic scenes while also supporting reproducibility and comparability of scientific results. Three virtual environments are provided (underground station, pub, living room), consisting of a detailed visual model, an acoustic geometry model with acoustic surface properties as well as a set of acoustic measurements in the respective real-world environments. The current data set enables i) audio–visual research in a reproducible set of environments, ii) comparison of room acoustic simulation methods with “ground truth” acoustic measurements, iii) a condensation point for future extensions and contributions for developments towards standardized test cases for ecologically valid hearing research in complex scenes.