Hamish Innes-Brown
Research Subjects
Research Interests
Hamish Innes-Brown has a total of 229 co-authors. Here are the top co-authors by number of shared publications:
- Jeremy Marozeau
Department of Basic Neurosciences, University of Geneva, Geneva, Switzerland
11 shared publications - Emina Alickovic
Department of Electrical Engineering Linköping University Linköping Sweden
5 shared publications - Joshua P. Kulasingham
Automatic Control, Department of Electrical Engineering, Linköping University
5 shared publications - Peter John Blamey
The Bionics Institute, East Melbourne, Australia; Dept. of Medical Bionics, University of Melbourne, Australia
5 shared publications - Florine L. Bachmann
Eriksholm Research Centre, Snekkersten, Denmark
4 shared publications - Kasper Eskelund
Oticon A/S
4 shared publications
Latest Publications
- Open Access
- 11 October 2026
- Published by Center for Open Science in PsyArXiv
Do Ocular and Facial Features Reflect Listening-Related Fatigue and Predict Rest Decisions in Adults With and Without Hearing Loss?
Listening-related fatigue is common in individuals with hearing loss and may affect decisions to continue with or disengage from listening, yet its objective assessment remains challenging. We used an effort-based decision-making paradigm to investigate whether subjective fatigue ratings predict objective eye- and face-related measures and whether the combination of subjective and objective measures predicts listen-or-rest decisions during a listening task.Twenty-seven German-speaking adults with normal hearing (NH; 35.7±13.1 years) and thirty Danish hearing-aid users (HA; 73.7±7.1 years) each completed 126 speech-in-noise trials with varying difficulty and reward, while on each trial they could decide whether to listen or to rest. Subsequently, subjective fatigue ratings were collected after each trial. Eye and facial features were recorded throughout the entire study. Analyses were conducted within groups and proceeded in two stages. First, linear mixed-effects models examined how subjective fatigue, task difficulty, reward, and response correctness predicted each eye and facial metric. Second, these metrics, along with the same predictors, were used to model trial-by-trial rest decisions.In NH participants, greater subjective fatigue was consistently associated with reduced eye openness and increased gaze velocity (small-to-medium effects), as well as higher blink rates (small effect). In HA users, greater fatigue similarly predicted reduced eye openness and increased gaze velocity (small-to-medium effects), together with a small increase in negative facial expressions. In both groups, rest decisions were more likely when task difficulty was higher, reward was lower, and subjective fatigue was higher. In NH participants, incorrect response and greater eye openness in the preceding trial additionally increased the probability of choosing rest.This work supports the assumption that ocular and facial indicators may serve as promising markers of preceding subjective fatigue and decisions to rest in people with hearing impairment. Recognizing these markers could play an important role in assessing and managing listening‑related fatigue.
- 11 October 2026
- Published by Center for Open Science in PsyArXiv
Open AccessDo Ocular and Facial Features Reflect Listening-Related Fatigue and Predict Rest Decisions in Adults With and Without Hearing Loss?
Listening-related fatigue is common in individuals with hearing loss and may affect decisions to continue with or disengage from listening, yet its objective assessment remains challenging. We used an effort-based decision-making paradigm to investigate whether subjective fatigue ratings predict objective eye- and face-related measures and whether the combination of subjective and objective measures predicts listen-or-rest decisions during a listening task.Twenty-seven German-speaking adults with normal hearing (NH; 35.7±13.1 years) and thirty Danish hearing-aid users (HA; 73.7±7.1 years) each completed 126 speech-in-noise trials with varying difficulty and reward, while on each trial they could decide whether to listen or to rest. Subsequently, subjective fatigue ratings were collected after each trial. Eye and facial features were recorded throughout the entire study. Analyses were conducted within groups and proceeded in two stages. First, linear mixed-effects models examined how subjective fatigue, task difficulty, reward, and response correctness predicted each eye and facial metric. Second, these metrics, along with the same predictors, were used to model trial-by-trial rest decisions.In NH participants, greater subjective fatigue was consistently associated with reduced eye openness and increased gaze velocity (small-to-medium effects), as well as higher blink rates (small effect). In HA users, greater fatigue similarly predicted reduced eye openness and increased gaze velocity (small-to-medium effects), together with a small increase in negative facial expressions. In both groups, rest decisions were more likely when task difficulty was higher, reward was lower, and subjective fatigue was higher. In NH participants, incorrect response and greater eye openness in the preceding trial additionally increased the probability of choosing rest.This work supports the assumption that ocular and facial indicators may serve as promising markers of preceding subjective fatigue and decisions to rest in people with hearing impairment. Recognizing these markers could play an important role in assessing and managing listening‑related fatigue.
- Open Access
Fatigue-related changes in value-based decision-making during listening are associated with increased frontal cortical activation
Hearing aid users commonly report listening-related fatigue, which may contribute to disengagement from demanding listening situations and negative psychosocial outcomes. Hearing rehabilitation currently lacks strategies to mitigate listening fatigue, partly because fatigue build-up and its consequences are difficult to measure beyond self-report. This study investigated whether value-based listening decisions and associated frontal cortical activity are modulated by fatigue. Thirty hearing aid users completed a one-hour listening paradigm while cortical hemodynamic activity was measured using functional near-infrared spectroscopy (fNIRS). On each trial, participants decided whether to engage in listening or rest based on an offer defined by expected task difficulty and reward, and rated their momentary fatigue. Fatigue ratings increased over time, and unsuccessful listening trials were associated with larger subsequent increases in fatigue, suggesting that performance contributed to changes in self-reported fatigue. Listen-versus-rest decisions followed the expected effort-reward trade-off, with participants more likely to accept offers that provided higher rewards and lower listening demands. Over the course of the experiment, participants became less likely to accept listening offers; however, neither time on task nor subjective fatigue altered the weighting of reward and difficulty. In contrast, frontal cortical activation during evaluation of accepted offers increased over time for high-difficulty offers with low or medium rewards. Follow-up analyses indicated that frontal oxygenation and listening decisions were more strongly associated with time on task than with subjective fatigue ratings. Together, these findings suggest that behavioral and neural measures obtained before listening capture fatigue-related processes beyond self-report, providing a basis for identifying and potentially addressing fatigue in hearing rehabilitation.
Open AccessFatigue-related changes in value-based decision-making during listening are associated with increased frontal cortical activation
Hearing aid users commonly report listening-related fatigue, which may contribute to disengagement from demanding listening situations and negative psychosocial outcomes. Hearing rehabilitation currently lacks strategies to mitigate listening fatigue, partly because fatigue build-up and its consequences are difficult to measure beyond self-report. This study investigated whether value-based listening decisions and associated frontal cortical activity are modulated by fatigue. Thirty hearing aid users completed a one-hour listening paradigm while cortical hemodynamic activity was measured using functional near-infrared spectroscopy (fNIRS). On each trial, participants decided whether to engage in listening or rest based on an offer defined by expected task difficulty and reward, and rated their momentary fatigue. Fatigue ratings increased over time, and unsuccessful listening trials were associated with larger subsequent increases in fatigue, suggesting that performance contributed to changes in self-reported fatigue. Listen-versus-rest decisions followed the expected effort-reward trade-off, with participants more likely to accept offers that provided higher rewards and lower listening demands. Over the course of the experiment, participants became less likely to accept listening offers; however, neither time on task nor subjective fatigue altered the weighting of reward and difficulty. In contrast, frontal cortical activation during evaluation of accepted offers increased over time for high-difficulty offers with low or medium rewards. Follow-up analyses indicated that frontal oxygenation and listening decisions were more strongly associated with time on task than with subjective fatigue ratings. Together, these findings suggest that behavioral and neural measures obtained before listening capture fatigue-related processes beyond self-report, providing a basis for identifying and potentially addressing fatigue in hearing rehabilitation.
- Open Access
Development of measures to assess listening-related effort and fatigue in daily life among hearing aid users: protocol for a quantitative field trial
Introduction Individuals with hearing loss and hearing aid users report higher levels of listening effort and fatigue in daily life compared with those with normal hearing. However, there is a lack of objective measures to evaluate these experiences in real-world settings. Recent studies have found that higher sound pressure levels (SPL) and lower signal-to-noise ratios (SNR) are linked to increased heart rate and decreased heart rate variability, reflecting the greater effort required to process auditory information. This study aims to establish physiological and acoustic predictors of self-reported listening effort and fatigue in daily life. Additionally, the moderating effects of cognitive abilities, personality traits, stress, fatigue, suprathreshold abilities, noise annoyance, lifestyle and health on the development of listening effort and fatigue will be investigated. Methods and analysis A 4-week field trial will be conducted, in which physiological responses will be continuously recorded using Empatica Embrace Plus wristbands. Ambient acoustics will be captured every 20 s via the participants’ (n=60) personal hearing aids, and the participants will provide self-reported momentary assessments through a mobile app throughout the day. Questionnaires will be used to assess personality traits, fatigue, stress and noise annoyance, and gather relevant background information. Cognitive and suprathreshold abilities will also be evaluated. Associations between physiological responses, ambient acoustics and momentary assessments, as well as the potential influence of participant characteristics, will be analysed using multilevel regression models and time-series analyses. Ethics and dissemination Informed consent will be obtained from all participants. The study has been exempted from ethical application by the Science Ethics Committee for the Capital Region of Denmark (journal no. F-23028367). Results will be presented at conferences and submitted for publication in peer-reviewed journals.
Open AccessDevelopment of measures to assess listening-related effort and fatigue in daily life among hearing aid users: protocol for a quantitative field trial
Introduction Individuals with hearing loss and hearing aid users report higher levels of listening effort and fatigue in daily life compared with those with normal hearing. However, there is a lack of objective measures to evaluate these experiences in real-world settings. Recent studies have found that higher sound pressure levels (SPL) and lower signal-to-noise ratios (SNR) are linked to increased heart rate and decreased heart rate variability, reflecting the greater effort required to process auditory information. This study aims to establish physiological and acoustic predictors of self-reported listening effort and fatigue in daily life. Additionally, the moderating effects of cognitive abilities, personality traits, stress, fatigue, suprathreshold abilities, noise annoyance, lifestyle and health on the development of listening effort and fatigue will be investigated. Methods and analysis A 4-week field trial will be conducted, in which physiological responses will be continuously recorded using Empatica Embrace Plus wristbands. Ambient acoustics will be captured every 20 s via the participants’ (n=60) personal hearing aids, and the participants will provide self-reported momentary assessments through a mobile app throughout the day. Questionnaires will be used to assess personality traits, fatigue, stress and noise annoyance, and gather relevant background information. Cognitive and suprathreshold abilities will also be evaluated. Associations between physiological responses, ambient acoustics and momentary assessments, as well as the potential influence of participant characteristics, will be analysed using multilevel regression models and time-series analyses. Ethics and dissemination Informed consent will be obtained from all participants. The study has been exempted from ethical application by the Science Ethics Committee for the Capital Region of Denmark (journal no. F-23028367). Results will be presented at conferences and submitted for publication in peer-reviewed journals.
- Open Access
- 1 October 2024
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 156 (4) , 2759-2766
Perceived auditory dynamic range is enhanced with wrist-based tactile stimulation
Tactile stimulation has been shown to increase auditory loudness judgments in listeners. This bias could be utilized to enhance perception for people with deficiencies in auditory intensity perception, such as cochlear implant users. However, several aspects of this enhancement remain uncertain. For instance, does the tactile stimulation need to be applied to the hand or body, or can it be applied to the wrist? Furthermore, can the tactile stimulation both amplify and attenuate the perceived auditory loudness? To address these questions, two loudness-matching experiments were conducted. Participants matched a comparison auditory stimulus with an auditory reference, either with or without spectro-temporally identical tactile stimulation. In the first experiment, fixed-level tactile stimulation was administered to the wrist during the comparison stimulus to assess whether perceived auditory loudness increased. The second experiment replicated the same conditions but introduced tactile stimulation to both the reference and comparison, aiming to investigate the potential decrease in perceived auditory loudness when the two tactile accompaniments were incongruent between the reference and comparison. The results provide evidence supporting the existence of the tactile loudness bias in each experiment and are a step towards wrist-based haptic devices that modulate the auditory dynamic range for a user.
- 1 October 2024
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 156 (4) , 2759-2766
Open AccessPerceived auditory dynamic range is enhanced with wrist-based tactile stimulation
Tactile stimulation has been shown to increase auditory loudness judgments in listeners. This bias could be utilized to enhance perception for people with deficiencies in auditory intensity perception, such as cochlear implant users. However, several aspects of this enhancement remain uncertain. For instance, does the tactile stimulation need to be applied to the hand or body, or can it be applied to the wrist? Furthermore, can the tactile stimulation both amplify and attenuate the perceived auditory loudness? To address these questions, two loudness-matching experiments were conducted. Participants matched a comparison auditory stimulus with an auditory reference, either with or without spectro-temporally identical tactile stimulation. In the first experiment, fixed-level tactile stimulation was administered to the wrist during the comparison stimulus to assess whether perceived auditory loudness increased. The second experiment replicated the same conditions but introduced tactile stimulation to both the reference and comparison, aiming to investigate the potential decrease in perceived auditory loudness when the two tactile accompaniments were incongruent between the reference and comparison. The results provide evidence supporting the existence of the tactile loudness bias in each experiment and are a step towards wrist-based haptic devices that modulate the auditory dynamic range for a user.
- Open Access
- 24 September 2024
- Published by Center for Open Science in MetaArXiv
The fNIRS Reproducibility Study Hub (FRESH): Exploring Variability and Enhancing Transparency in fNIRS Neuroimaging Research
In neuroimaging research, efforts to enhance replication and reproducibility have increased the focus on improving transparency, particularly in the complex data analysis processes. We conducted a multi-lab collaborative study involving 38 international teams that analyzed two functional Near-Infrared Spectroscopy (fNIRS) datasets. These teams tested seven group-level and forty individual-level hypotheses, and they submitted detailed reports on their analysis pipelines and testing outcomes. The results showed significant variability in hypothesis testing outcomes due to differences in analytical approaches. There was greater consensus in group-level analyses compared to individual-level analyses. Factors such as the pruning method, hemodynamic response function model and estimation, and statistical analysis space partly account for the variability in hypothesis testing outcomes. Additionally, we have found higher similarity in hypothesis testing outcomes across the researchers who reported higher confidence in their analysis skills. This study underscores the importance of complying with best practices in fNIRS analysis methodologies and the need for standardized analysis protocols to improve reliability and credibility.
- 24 September 2024
- Published by Center for Open Science in MetaArXiv
Open AccessThe fNIRS Reproducibility Study Hub (FRESH): Exploring Variability and Enhancing Transparency in fNIRS Neuroimaging Research
In neuroimaging research, efforts to enhance replication and reproducibility have increased the focus on improving transparency, particularly in the complex data analysis processes. We conducted a multi-lab collaborative study involving 38 international teams that analyzed two functional Near-Infrared Spectroscopy (fNIRS) datasets. These teams tested seven group-level and forty individual-level hypotheses, and they submitted detailed reports on their analysis pipelines and testing outcomes. The results showed significant variability in hypothesis testing outcomes due to differences in analytical approaches. There was greater consensus in group-level analyses compared to individual-level analyses. Factors such as the pruning method, hemodynamic response function model and estimation, and statistical analysis space partly account for the variability in hypothesis testing outcomes. Additionally, we have found higher similarity in hypothesis testing outcomes across the researchers who reported higher confidence in their analysis skills. This study underscores the importance of complying with best practices in fNIRS analysis methodologies and the need for standardized analysis protocols to improve reliability and credibility.
- Open Access
- 24 September 2024
- Published by Center for Open Science in MetaArXiv
The fNIRS Reproducibility Study Hub (FRESH): Exploring Variability and Enhancing Transparency in fNIRS Neuroimaging Research
In neuroimaging research, efforts to enhance replication and reproducibility have increased the focus on improving transparency, particularly in the complex data analysis processes. We conducted a multi-lab collaborative study involving 38 international teams that analyzed two functional Near-Infrared Spectroscopy (fNIRS) datasets. These teams tested seven group-level and forty individual-level hypotheses, and they submitted detailed reports on their analysis pipelines and testing outcomes. The results showed significant variability in hypothesis testing outcomes due to differences in analytical approaches. There was greater consensus in group-level analyses compared to individual-level analyses. Factors such as the pruning method, hemodynamic response function model and estimation, and statistical analysis space partly account for the variability in hypothesis testing outcomes. Additionally, we have found higher similarity in hypothesis testing outcomes across the researchers who reported higher confidence in their analysis skills. This study underscores the importance of complying with best practices in fNIRS analysis methodologies and the need for standardized analysis protocols to improve reliability and credibility.
- 24 September 2024
- Published by Center for Open Science in MetaArXiv
Open AccessThe fNIRS Reproducibility Study Hub (FRESH): Exploring Variability and Enhancing Transparency in fNIRS Neuroimaging Research
In neuroimaging research, efforts to enhance replication and reproducibility have increased the focus on improving transparency, particularly in the complex data analysis processes. We conducted a multi-lab collaborative study involving 38 international teams that analyzed two functional Near-Infrared Spectroscopy (fNIRS) datasets. These teams tested seven group-level and forty individual-level hypotheses, and they submitted detailed reports on their analysis pipelines and testing outcomes. The results showed significant variability in hypothesis testing outcomes due to differences in analytical approaches. There was greater consensus in group-level analyses compared to individual-level analyses. Factors such as the pruning method, hemodynamic response function model and estimation, and statistical analysis space partly account for the variability in hypothesis testing outcomes. Additionally, we have found higher similarity in hypothesis testing outcomes across the researchers who reported higher confidence in their analysis skills. This study underscores the importance of complying with best practices in fNIRS analysis methodologies and the need for standardized analysis protocols to improve reliability and credibility.
- Open Access
- 1 May 2024
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 155 (5) , 3101-3117
Some, but not all, cochlear implant users prefer music stimuli with congruent haptic stimulation
Cochlear implant (CI) users often report being unsatisfied by music listening through their hearing device. Vibrotactile stimulation could help alleviate those challenges. Previous research has shown that musical stimuli was given higher preference ratings by normal-hearing listeners when concurrent vibrotactile stimulation was congruent in intensity and timing with the corresponding auditory signal compared to incongruent. However, it is not known whether this is also the case for CI users. Therefore, in this experiment, we presented 18 CI users and 24 normal-hearing listeners with five melodies and five different audio-to-tactile maps. Each map varied the congruence between the audio and tactile signals related to intensity, fundamental frequency, and timing. Participants were asked to rate the maps from zero to 100, based on preference. It was shown that almost all normal-hearing listeners, as well as a subset of the CI users, preferred tactile stimulation, which was congruent with the audio in intensity and timing. However, many CI users had no difference in preference between timing aligned and timing unaligned stimuli. The results provide evidence that vibrotactile music enjoyment enhancement could be a solution for some CI users; however, more research is needed to understand which CI users can benefit from it most.
- 1 May 2024
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 155 (5) , 3101-3117
Open AccessSome, but not all, cochlear implant users prefer music stimuli with congruent haptic stimulation
Cochlear implant (CI) users often report being unsatisfied by music listening through their hearing device. Vibrotactile stimulation could help alleviate those challenges. Previous research has shown that musical stimuli was given higher preference ratings by normal-hearing listeners when concurrent vibrotactile stimulation was congruent in intensity and timing with the corresponding auditory signal compared to incongruent. However, it is not known whether this is also the case for CI users. Therefore, in this experiment, we presented 18 CI users and 24 normal-hearing listeners with five melodies and five different audio-to-tactile maps. Each map varied the congruence between the audio and tactile signals related to intensity, fundamental frequency, and timing. Participants were asked to rate the maps from zero to 100, based on preference. It was shown that almost all normal-hearing listeners, as well as a subset of the CI users, preferred tactile stimulation, which was congruent with the audio in intensity and timing. However, many CI users had no difference in preference between timing aligned and timing unaligned stimuli. The results provide evidence that vibrotactile music enjoyment enhancement could be a solution for some CI users; however, more research is needed to understand which CI users can benefit from it most.
- Open Access
Level Dependent Subcortical EEG Responses to Continuous Speech
The auditory brainstem response (ABR) is a measure of subcortical activity in response to auditory stimuli. The wave V peak of the ABR depends on stimulus intensity level, and has been widely used for clinical hearing assessment. Conventional methods to estimate the ABR average electroencephalography (EEG) responses to short unnatural stimuli such as clicks. Recent work has moved towards more ecologically relevant continuous speech stimuli using linear deconvolution models called Temporal Response Functions (TRFs). Investigating whether the TRF waveform changes with stimulus intensity is a crucial step towards the use of natural speech stimuli for hearing assessments involving subcortical responses. Here, we develop methods to estimate level-dependent subcortical TRFs using EEG data collected from 21 participants listening to continuous speech presented at 4 different intensity levels. We find that level-dependent changes can be detected in the wave V peak of the subcortical TRF for almost all participants, and are consistent with level-dependent changes in click-ABR wave V. We also investigate the most suitable peripheral auditory model to generate predictors for level-dependent subcortical TRFs and find that simple gammatone filterbanks perform the best. Additionally, around 6 minutes of data may be sufficient for detecting level-dependent effects and wave V peaks above the noise floor for speech segments with higher intensity. Finally, we show a proof-of-concept that level dependent subcortical TRFs can be detected even for the inherent intensity fluctuations in natural continuous speech. Significance statement Subcortical EEG responses to sound depend on the stimulus intensity level and provide a window into the early human auditory pathway. However, current methods detect responses using unnatural transient stimuli such as clicks or chirps. We develop methods for detecting level-dependent responses to continuous speech stimuli, which is more ecologically relevant and may provide several advantages over transient stimuli. Critically, we find consistent patterns of level dependent subcortical responses to continuous speech at an individual level, that are directly comparable to those seen for conventional responses to click stimuli. Our work lays the foundation for the use of subcortical responses to natural speech stimuli in future applications such as clinical hearing assessment and hearing assistive technology.
Open AccessLevel Dependent Subcortical EEG Responses to Continuous Speech
The auditory brainstem response (ABR) is a measure of subcortical activity in response to auditory stimuli. The wave V peak of the ABR depends on stimulus intensity level, and has been widely used for clinical hearing assessment. Conventional methods to estimate the ABR average electroencephalography (EEG) responses to short unnatural stimuli such as clicks. Recent work has moved towards more ecologically relevant continuous speech stimuli using linear deconvolution models called Temporal Response Functions (TRFs). Investigating whether the TRF waveform changes with stimulus intensity is a crucial step towards the use of natural speech stimuli for hearing assessments involving subcortical responses. Here, we develop methods to estimate level-dependent subcortical TRFs using EEG data collected from 21 participants listening to continuous speech presented at 4 different intensity levels. We find that level-dependent changes can be detected in the wave V peak of the subcortical TRF for almost all participants, and are consistent with level-dependent changes in click-ABR wave V. We also investigate the most suitable peripheral auditory model to generate predictors for level-dependent subcortical TRFs and find that simple gammatone filterbanks perform the best. Additionally, around 6 minutes of data may be sufficient for detecting level-dependent effects and wave V peaks above the noise floor for speech segments with higher intensity. Finally, we show a proof-of-concept that level dependent subcortical TRFs can be detected even for the inherent intensity fluctuations in natural continuous speech. Significance statement Subcortical EEG responses to sound depend on the stimulus intensity level and provide a window into the early human auditory pathway. However, current methods detect responses using unnatural transient stimuli such as clicks or chirps. We develop methods for detecting level-dependent responses to continuous speech stimuli, which is more ecologically relevant and may provide several advantages over transient stimuli. Critically, we find consistent patterns of level dependent subcortical responses to continuous speech at an individual level, that are directly comparable to those seen for conventional responses to click stimuli. Our work lays the foundation for the use of subcortical responses to natural speech stimuli in future applications such as clinical hearing assessment and hearing assistive technology.
- Top Cited PapersOpen Access
- 8 February 2024
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 19 (2) , e0297826
Predictors for estimating subcortical EEG responses to continuous speech
Perception of sounds and speech involves structures in the auditory brainstem that rapidly process ongoing auditory stimuli. The role of these structures in speech processing can be investigated by measuring their electrical activity using scalp-mounted electrodes. However, typical analysis methods involve averaging neural responses to many short repetitive stimuli that bear little relevance to daily listening environments. Recently, subcortical responses to more ecologically relevant continuous speech were detected using linear encoding models. These methods estimate the temporal response function (TRF), which is a regression model that minimises the error between the measured neural signal and a predictor derived from the stimulus. Using predictors that model the highly non-linear peripheral auditory system may improve linear TRF estimation accuracy and peak detection. Here, we compare predictors from both simple and complex peripheral auditory models for estimating brainstem TRFs on electroencephalography (EEG) data from 24 participants listening to continuous speech. We also investigate the data length required for estimating subcortical TRFs, and find that around 12 minutes of data is sufficient for clear wave V peaks (>3 dB SNR) to be seen in nearly all participants. Interestingly, predictors derived from simple filterbank-based models of the peripheral auditory system yield TRF wave V peak SNRs that are not significantly different from those estimated using a complex model of the auditory nerve, provided that the nonlinear effects of adaptation in the auditory system are appropriately modelled. Crucially, computing predictors from these simpler models is more than 50 times faster compared to the complex model. This work paves the way for efficient modelling and detection of subcortical processing of continuous speech, which may lead to improved diagnosis metrics for hearing impairment and assistive hearing technology.
- 8 February 2024
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 19 (2) , e0297826
Top Cited PapersOpen AccessPredictors for estimating subcortical EEG responses to continuous speech
Perception of sounds and speech involves structures in the auditory brainstem that rapidly process ongoing auditory stimuli. The role of these structures in speech processing can be investigated by measuring their electrical activity using scalp-mounted electrodes. However, typical analysis methods involve averaging neural responses to many short repetitive stimuli that bear little relevance to daily listening environments. Recently, subcortical responses to more ecologically relevant continuous speech were detected using linear encoding models. These methods estimate the temporal response function (TRF), which is a regression model that minimises the error between the measured neural signal and a predictor derived from the stimulus. Using predictors that model the highly non-linear peripheral auditory system may improve linear TRF estimation accuracy and peak detection. Here, we compare predictors from both simple and complex peripheral auditory models for estimating brainstem TRFs on electroencephalography (EEG) data from 24 participants listening to continuous speech. We also investigate the data length required for estimating subcortical TRFs, and find that around 12 minutes of data is sufficient for clear wave V peaks (>3 dB SNR) to be seen in nearly all participants. Interestingly, predictors derived from simple filterbank-based models of the peripheral auditory system yield TRF wave V peak SNRs that are not significantly different from those estimated using a complex model of the auditory nerve, provided that the nonlinear effects of adaptation in the auditory system are appropriately modelled. Crucially, computing predictors from these simpler models is more than 50 times faster compared to the complex model. This work paves the way for efficient modelling and detection of subcortical processing of continuous speech, which may lead to improved diagnosis metrics for hearing impairment and assistive hearing technology.
- Open Access
- 1 January 2024
- Published by SAGE Publications in Trends in Hearing
- Vol. 28
Extending Subcortical EEG Responses to Continuous Speech to the Sound-Field
The auditory brainstem response (ABR) is a valuable clinical tool for objective hearing assessment, which is conventionally detected by averaging neural responses to thousands of short stimuli. Progressing beyond these unnatural stimuli, brainstem responses to continuous speech presented via earphones have been recently detected using linear temporal response functions (TRFs). Here, we extend earlier studies by measuring subcortical responses to continuous speech presented in the sound-field, and assess the amount of data needed to estimate brainstem TRFs. Electroencephalography (EEG) was recorded from 24 normal hearing participants while they listened to clicks and stories presented via earphones and loudspeakers. Subcortical TRFs were computed after accounting for non-linear processing in the auditory periphery by either stimulus rectification or an auditory nerve model. Our results demonstrated that subcortical responses to continuous speech could be reliably measured in the sound-field. TRFs estimated using auditory nerve models outperformed simple rectification, and 16 minutes of data was sufficient for the TRFs of all participants to show clear wave V peaks for both earphones and sound-field stimuli. Subcortical TRFs to continuous speech were highly consistent in both earphone and sound-field conditions, and with click ABRs. However, sound-field TRFs required slightly more data (16 minutes) to achieve clear wave V peaks compared to earphone TRFs (12 minutes), possibly due to effects of room acoustics. By investigating subcortical responses to sound-field speech stimuli, this study lays the groundwork for bringing objective hearing assessment closer to real-life conditions, which may lead to improved hearing evaluations and smart hearing technologies.
- 1 January 2024
- Published by SAGE Publications in Trends in Hearing
- Vol. 28
Open AccessExtending Subcortical EEG Responses to Continuous Speech to the Sound-Field
The auditory brainstem response (ABR) is a valuable clinical tool for objective hearing assessment, which is conventionally detected by averaging neural responses to thousands of short stimuli. Progressing beyond these unnatural stimuli, brainstem responses to continuous speech presented via earphones have been recently detected using linear temporal response functions (TRFs). Here, we extend earlier studies by measuring subcortical responses to continuous speech presented in the sound-field, and assess the amount of data needed to estimate brainstem TRFs. Electroencephalography (EEG) was recorded from 24 normal hearing participants while they listened to clicks and stories presented via earphones and loudspeakers. Subcortical TRFs were computed after accounting for non-linear processing in the auditory periphery by either stimulus rectification or an auditory nerve model. Our results demonstrated that subcortical responses to continuous speech could be reliably measured in the sound-field. TRFs estimated using auditory nerve models outperformed simple rectification, and 16 minutes of data was sufficient for the TRFs of all participants to show clear wave V peaks for both earphones and sound-field stimuli. Subcortical TRFs to continuous speech were highly consistent in both earphone and sound-field conditions, and with click ABRs. However, sound-field TRFs required slightly more data (16 minutes) to achieve clear wave V peaks compared to earphone TRFs (12 minutes), possibly due to effects of room acoustics. By investigating subcortical responses to sound-field speech stimuli, this study lays the groundwork for bringing objective hearing assessment closer to real-life conditions, which may lead to improved hearing evaluations and smart hearing technologies.