IOItsaso Olasagasti

Itsaso Olasagasti

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Itsaso Olasagasti has a total of 66 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    From Images and Words to Modality-Independent Semantic Representations: When and Where They Emerge

    by Nicolas Piron, Théo Desbordes, Itsaso Olasagasti, Sophie Schwartz, Nina Kazanina

    Conceptual knowledge can be accessed from different modalities, such as seeing an image or reading a written word. While prior neuroimaging studies implicate anterior temporal cortex in modality-independent semantic representations, when and how representations evoked by images and words converge onto a modality-independent code remains unclear. Moreover, evidence for modality-independent category representations comes largely from tasks that explicitly required semantic processing, leaving open whether such representations emerge when semantic category and stimulus modality are task-irrelevant. We magnetoencephalography (MEG) to determine when and where modality-independent semantic category representations emerge across images and words when participants (n = 32) encoded six-item sequences containing an exemplar of six semantic categories counterbalanced across positions and reported the ordinal position of a probed item. Decoding performance was above chance for all categories in each modality from approximately 70 ms relative to item presentation. Generalization peaked at similar latencies for the two modalities (∼520-530 ms), where image and word classifiers had the most similar coefficients. In both transfer directions, activity elicited by images generalized mostly to later activity elicited by words, and a given period of the image response shared its category code with a longer period of the word response. Source-space decoding around the peak of generalization identified the same regions for both transfer directions: left and right anterior temporal lobe, perisylvian cortex (more extensive in the left hemisphere), right visual cortex, and bilateral orbitofrontal cortex, indicating a modality-independent category code distributed across the cortex.

  • Open Access

    Temporal evolution of neural codes: The added value of a geometric approach to linear coefficients

    by Théo Desbordes, Itsaso Olasagasti, Nicolas Piron, Sophie Schwartz, Nina Kazanina


  • Top Cited Papers
    Open Access

    Rhythmic modulation of prediction errors: A top-down gating role for the beta-range in speech processing

    by Sevada Hovsepyan, Itsaso Olasagasti, Anne-Lise Giraud

    Natural speech perception requires processing the ongoing acoustic input while keeping in mind the preceding one and predicting the next. This complex computational problem could be handled by a dynamic multi-timescale hierarchical inferential process that coordinates the information flow up and down the language network hierarchy. Using a predictive coding computational model (Precoss-β) that identifies online individual syllables from continuous speech, we address the advantage of a rhythmic modulation of up and down information flows, and whether beta oscillations could be optimal for this. In the model, and consistent with experimental data, theta and low-gamma neural frequency scales ensure syllable-tracking and phoneme-level speech encoding, respectively, while the beta rhythm is associated with inferential processes. We show that a rhythmic alternation of bottom-up and top-down processing regimes improves syllable recognition, and that optimal efficacy is reached when the alternation of bottom-up and top-down regimes, via oscillating prediction error precisions, is in the beta range (around 20–30 Hz). These results not only demonstrate the advantage of a rhythmic alternation of up- and down-going information, but also that the low-beta range is optimal given sensory analysis at theta and low-gamma scales. While specific to speech processing, the notion of alternating bottom-up and top-down processes with frequency multiplexing might generalize to other cognitive architectures. During speech perception, our brain achieves continuous acoustic analysis of the ongoing speech signal, its transformation into linguistic representations, and the prediction of the most likely next words or syllables. In this computational study, we address the biological mechanisms underpinning the coordination of these operations during natural speech processing. Using a model that recognizes on-line syllables in natural sentences, we show that neural activity at specific rhythms is dedicated to specific operations, and that while the theta and low-gamma rhythms are engaged in speech features signaling and encoding, the more endogenous low-beta rhythm drives the rhythmic and coordinated modulation of prediction errors across levels of hierarchy.


  • Open Access

    A deep hierarchy of predictions enables assignment of semantic roles in online speech comprehension

    by Yaqing Su, Lucy J. MacGregor, Itsaso Olasagasti, Anne-Lise Giraud

    Understanding speech requires mapping fleeting and often ambiguous soundwaves to meaning. While humans are known to exploit their capacity to contextualize to facilitate this process, how internal knowledge is deployed on-line remains an open question. Here, we present a model that extracts multiple levels of information from continuous speech online. The model applies linguistic and nonlinguistic knowledge to speech processing, by periodically generating top-down predictions and incorporating bottom-up incoming evidence in a nested temporal hierarchy. We show that a nonlinguistic context level provides semantic predictions informed by sensory inputs, which are crucial for disambiguating among multiple meanings of the same word. The explicit knowledge hierarchy of the model enables a more holistic account of the neurophysiological responses to speech compared to using lexical predictions generated by a neural-network language model (GPT-2). We also show that hierarchical predictions reduce peripheral processing via minimizing uncertainty and prediction error. With this proof-of-concept model we demonstrate that the deployment of hierarchical predictions is a possible strategy for the brain to dynamically utilize structured knowledge and make sense of the speech input.


  • Open Access

    Rhythmic modulation of prediction errors: a possible role for the beta-range in speech processing

    by Sevada Hovsepyan, Itsaso Olasagasti, Anne-Lise Giraud

    Natural speech perception requires processing the current acoustic input while keeping in mind the preceding one and predicting the next. This complex computational problem could be handled by a multi timescale hierarchical inferential process that coordinates information flow up and down the language hierarchy. While theta and low-gamma neural frequency scales are convincingly involved in bottom-up syllable-tracking and phoneme-level speech encoding, the beta rhythm is more loosely associated with top-down processes without being assigned yet a specific computational function. Here we tested the hypothesis that the beta rhythm drives the precision of states during the speech recognition hierarchical inference process. We used a predictive coding model that recognizes syllables on-line in natural sentences, in which the precision of prediction errors is rhythmically modulated, resulting in alternating bottom-up vs. top-down processing regimes. We show that recognition performance increases with the rate of precision updates, with an optimal efficacy in the beta range (around 20 Hz). The model further performs when prediction errors pertaining respectively to syllable timing and syllable identity oscillate in antiphase. These results suggest that online syllable recognition globally benefits from the alternation of bottom-up and top-down dominant regime at beta rate, and that the gain is stronger when different features are also analyzed in alternation. These results speak to a discontinuous account of inferential operations in speech processing.


  • Open Access

    Integrating prediction errors at two time scales permits rapid recalibration of speech sound categories

    by Itsaso Olasagasti, Anne-Lise Giraud

    Speech perception presumably arises from internal models of how specific sensory features are associated with speech sounds. These features change constantly (e.g. different speakers, articulation modes etc.), and listeners need to recalibrate their internal models by appropriately weighing new versus old evidence. Models of speech recalibration classically ignore this volatility. The effect of volatility in tasks where sensory cues were associated with arbitrary experimenter-defined categories were well described by models that continuously adapt the learning rate while keeping a single representation of the category. Using neurocomputational modelling we show that recalibration of natural speech sound categories is better described by representing the latter at different time scales. We illustrate our proposal by modeling fast recalibration of speech sounds after experiencing the McGurk effect. We propose that working representations of speech categories are driven both by their current environment and their long-term memory representations.


  • Open Access

    Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure

    by Sophie Bouton, Jaime Delgado-Saa, Itsaso Olasagasti, Anne-Lise Giraud

    In face-to-face communication, audio-visual (AV) stimuli can be fused, combined or perceived as mismatching. While the left superior temporal sulcus (STS) is admittedly the locus of AV integration, the process leading to combination is unknown. Analysing behaviour and time-/source-resolved human MEG data, we show that while fusion and combination both involve early detection of AV physical features discrepancy in the STS, combination is associated in with activity of AV asynchrony-sensitive regions (auditory and inferior frontal cortices). Based on dynamic causal modelling, and neural signal decoding, we further show that AV speech integration outcome primarily depends on whether the STS can quickly converge onto an existing multimodal syllable representation, and that combination results from subsequent temporal processing, presumably re-ordering, of discrepant AV stimuli.

  • Open Access

    Converging intracortical signatures of two separated processing timescales in human early auditory cortex

    by Fabiano Baroni, Benjamin Morillon, Agnès Trébuchon, Catherine Liégeois-Chauvel, Itsaso Olasagasti, Anne-Lise Giraud

    Neural oscillations in auditory cortex are argued to support parsing and representing speech constituents at their corresponding temporal scales. Yet, how incoming sensory information interacts with ongoing spontaneous brain activity, what features of the neuronal microcircuitry underlie spontaneous and stimulus-evoked spectral fingerprints, and what these fingerprints entail for stimulus encoding, remain largely open questions. We used a combination of human invasive electrophysiology, computational modeling and decoding techniques to assess the information encoding properties of brain activity and to relate them to a plausible underlying neuronal microarchitecture. We analyzed intracortical auditory EEG activity from 10 patients while they were listening to short sentences. Pre-stimulus neural activity in early auditory cortical regions often exhibited power spectra with a shoulder in the delta range and a small bump in the beta range. Speech decreased power in the beta range, and increased power in the delta-theta and gamma ranges. Using multivariate machine learning techniques, we assessed the spectral profile of information content for two aspects of speech processing: detection and discrimination. We obtained better phase than power information decoding, and a bimodal spectral profile of information content with better decoding at low (delta-theta) and high (gamma) frequencies than at intermediate (beta) frequencies. These experimental data were reproduced by a simple rate model made of two subnetworks with different timescales, each composed of coupled excitatory and inhibitory units, and connected via a negative feedback loop. Modeling and experimental results were similar in terms of pre-stimulus spectral profile (except for the iEEG beta bump), spectral modulations with speech, and spectral profile of information content. Altogether, we provide converging evidence from both univariate spectral analysis and decoding approaches for a dual timescale processing infrastructure in human auditory cortex, and show that it is consistent with the dynamics of a simple rate model. Author summary: Like most animal vocalizations, speech results from a pseudo-rhythmic process that reflects the convergence of motor and auditory neural substrates and the natural resonance properties of the vocal apparatus towards efficient communication. Here, we leverage the excellent temporal and spatial resolution of intracranial EEG to demonstrate that neural activity in human early auditory cortical areas during speech perception exhibits a dual-scale spectral profile of power changes, with speech increasing power in low (delta-theta) and high (gamma - high-gamma) frequency ranges, while decreasing power in intermediate (alpha-beta) frequencies. Single-trial multivariate decoding also resulted in a bimodal spectral profile of information content, with better decoding at low and high frequencies than at intermediate ones. From both spectral and informational perspectives, these patterns are consistent with the activity of a relatively simple computational model comprising two reciprocally connected excitatory/inhibitory sub-networks operating at different (low and high) timescales. By combining experimental, decoding and modeling approaches, we provide consistent evidence for the existence, information coding value and underlying neuronal architecture of dual timescale processing in human auditory cortex.

  • Open Access

    Integrating prediction errors at two time scales permits rapid recalibration of speech sound categories

    by Itsaso Olasagasti, Anne-Lise Giraud

    Speech perception is assumed to arise from internal models of specific sensory features associated speech sounds. When these features change, the listener should recalibrate its internal model by appropriately weighing new versus old evidence in a volatility dependent manner. Models of speech recalibration have classically ignored volatility. Those that explicitly consider volatility have been designed to describe human behavior in tasks where sensory cues are associated with arbitrary experimenter-defined categories or rewards. In such settings, a model that maintains a single representation of the category but continuously adapts the learning rate works well. Using neurocomputational modelling we show that recalibration of existing “natural” categories is better described when sound categories are represented at different time scales. We illustrate our proposal by modeling the rapid recalibration of speech categories (Lüttke et al. 2016).