Aligning Text/Speech Representations from Multimodal Models with MEG Brain Activity During Listening
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 34457-34474
Abstract
Padakanti Srijith, Khushbu Pahwa, Radhika Mamidi, Bapi Raju Surampudi, Manish Gupta, Subba Reddy Oota. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.Keywords
This publication has 12 references indexed in Scilit:
- The cortical representation of language timescales is shared between reading and listeningCommunications Biology, 2024
- Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regionsPLOS Biology, 2023
- Introducing MEG-MASC a high-quality magneto-encephalography dataset for evaluating natural speech processingScientific Data, 2023
- Combining computational controls with natural text reveals aspects of meaning compositionNature Computational Science, 2022
- Neural dynamics of phoneme sequences reveal position-invariant code for content and orderNature Communications, 2022
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech ProcessingIEEE Journal of Selected Topics in Signal Processing, 2022
- Brains and algorithms partially converge in natural language processingCommunications Biology, 2022
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- Simultaneously Uncovering the Patterns of Brain Regions Involved in Different Story Reading SubprocessesPLOS ONE, 2014
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingJournal of the Royal Statistical Society Series B: Statistical Methodology, 1995