GWGordon Wichern

Gordon Wichern

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Gordon Wichern has a total of 65 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Mind the Gap: Detecting Cluster Exits for Robust Local Density-Based Score Normalization in Anomalous Sound Detection

    by Kevin Wilkinghoff, Gordon Wichern, Jonathan Le Roux, Zheng-Hua Tan

    Local density-based score normalization is an effective component of distance-based embedding methods for anomalous sound detection, particularly when data densities vary across conditions or domains. In practice, however, performance depends strongly on neighborhood size. Increasing it can degrade detection accuracy when neighborhood expansion crosses cluster boundaries, violating the locality assumption of local density estimation. This observation motivates adapting the neighborhood size based on locality preservation rather than fixing it in advance. We realize this by proposing cluster exit detection, a lightweight mechanism that identifies distance discontinuities and selects neighborhood sizes accordingly. Experiments across multiple embedding models and datasets show improved robustness to neighborhood-size selection and consistent performance gains.

  • Open Access

    RANF: Neural Field-Based HRTF Spatial Upsampling with Retrieval Augmentation and Parameter Efficient Fine-Tuning

    by Yoshiki Masuyama, Gordon Wichern, François G. Germain, Christopher Ick, Jonathan Le Roux

    This paper gives an in-depth description of our submission to Task 2 of the Listener Acoustic Personalization (LAP) challenge 2024, which aims to reconstruct head-related transfer functions (HRTFs) with dense spatial grids from sparse measurements. Neural fields (NFs) with parameter-efficient fine-tuning (PEFT) have led to dramatic performance improvements in HRTF spatial upsampling and personalization. Despite these advances, spatial upsampling performance remains limited in scenarios with very sparse measurements. Our proposed system, named retrieval-augmented NF (RANF), incorporates HRTFs retrieved from a dataset as auxiliary inputs. We leverage multiple retrievals via transform-average-concatenate and adopt a PEFT technique tailored for retrieval augmentation. Furthermore, we capitalize on the results of a signal-processing-based spatial upsampling method as optional inputs. By incorporating these auxiliary inputs, our system demonstrated state-of-the-art performance on the SONICOM dataset and placed first in Task 2 of the LAP challenge 2024.

  • Open Access

    Embracing Cacophony: Explaining and Improving Random Mixing in Music Source Separation

    by Chang-Bin Jeon, Gordon Wichern, François G. Germain, Jonathan Le Roux

    In music source separation, a standard data augmentation technique involves creating new training examples by randomly combining instrument stems from different songs. However, these randomly mixed samples lack the natural coherence of real music, as their stems do not share a consistent beat or tonality, often resulting in a cacophony. Despite this apparent distribution shift, random mixing has been widely adopted due to its effectiveness. In this work, we investigate why random mixing improves performance when training a state-of-the-art music source separation model and analyze the factors that cause performance gains to plateau despite the theoretically limitless number of possible combinations. We further explore the impact of beat and tonality mismatches on separation performance. Beyond analyzing random mixing, we introduce ways to further enhance its effectiveness. First, we explore a multi-segment sampling strategy that increases the diversity of training examples by selecting multiple segments for the target source. Second, we incorporate a digital parametric equalizer, a fundamental tool in music production, to maximize the timbral diversity of random mixes. Our experiments demonstrate that a model trained with only 100 songs from the MUSDB18-HQ dataset, combined with our proposed methods, achieves competitive performance to a BS-RNN model trained with 1,750 additional songs.

  • Local Density-Based Anomaly Score Normalization for Domain Generalization

    by Kevin Wilkinghoff, Haici Yang, Janek Ebbers, François G. Germain, Gordon Wichern, Jonathan Le Roux

    State-of-the-art (ASD) systems in domain-shifted conditions rely on projecting audio signals into an embedding space and using distance-based outlier detection to compute anomaly scores. One of the major difficulties to overcome is the so-called domain mismatch between the anomaly score distributions of a source domain and a target domain that differ acoustically and in terms of the amount of training data provided. A decision threshold that is optimal for one domain may be highly sub-optimal for the other domain and vice versa. This significantly degrades the performance when only using a single decision threshold, as is required when generalizing to multiple data domains that are possibly unseen during training while still using the same trained ASD system as in the source domain. To reduce this mismatch between the domains, we propose a simple local-density-based anomaly score normalization scheme. In experiments conducted on several ASD datasets, we show that the proposed normalization scheme consistently improves performance for various types of embedding-based ASD systems and yields better results than existing anomaly score normalization approaches.


  • Open Access

    SuDaField: Subject- and Dataset-Aware Neural Field for HRTF Modeling

    by Yoshiki Masuyama, Gordon Wichern, François G. Germain, Christopher Ick, Jonathan Le Roux

    This paper presents SuDaField, a subject- and dataset-aware neural field (NF) that can leverage multiple head-related transfer function (HRTF) datasets. NF-based HRTF modeling has gained much attention because its grid-agnostic formulation accommodates any spatial grids during training and inference. While NFs are grid-agnostic, their training on multiple datasets remains challenging, as HRTFs from different datasets exhibit distinct characteristics due to variations in measurement setups. To mitigate this issue, Task 1 of the Listener Acoustic Personalization (LAP) Challenge 2024 proposed the task of HRTF harmonization, which aims to compensate for dataset-specific effects while preserving spatial cues of the original HRTFs. The harmonization itself is still hindered by the difference in spatial grids and the ill-defined nature of ideal harmonized HRTFs. We thus propose a well-defined framework of HRTF conversion and realize this by concurrently performing NF training and disentanglement of subject- and dataset-specific information. Our NF adopts dataset-specific parameters shared across all subjects within each dataset, with these parameters capturing the influence of the measurement setups. By replacing the dataset-specific parameters with those of another dataset, we can convert HRTFs recorded in one environment to what they would be if recorded in another environment. Our experimental results show that the dataset-specific parameters allow us to effectively perform HRTF conversion, achieving state-of-the-art performance on Task 1 of the LAP Challenge 2024.


  • Open Access

    Flexible source separation for decomposing acoustic scenes and events

    by Gordon Wichern, Kohei Saijo, François Germain, Jonathan Le Roux

    In addition to detection, classification, and localization of sound events, the ability to isolate the sound of one or multiple sound sources in an acoustic scene is important for downstream applications such as assisted listening, and virtual/augmented reality. Because of the wide variety of possible sound sources we may want to isolate, the ability to flexibly specify the source(s) of interest (e.g., via natural language queries) is necessary for most practical applications. In this talk I will first discuss the advantages and disadvantages of natural language queries for audio source extraction. I will then discuss Task-aware Unified Source Separation (TUSS), a recent prompt-based separation model that can decompose a sound scene into a flexible number of output sources including multiple sources of the same type.

  • Probabilistic forecasting for building energy systems using time-series foundation models

    by Young-Jin Park, François Germain, Jing Liu, Ye Wang, Toshiaki Koike-Akino, Gordon Wichern, Navid Azizan, Christopher Laughman, Ankush Chakrabarty


  • Open Access

    Exploring Disentangled Neural Speech Codecs from Self-Supervised Representations

    by Ryo Aihara, Yoshiki Masuyama, Gordon Wichern, François G. Germain, Jonathan Le Roux

    Neural audio codecs (NACs), which use neural networks to generate compact audio representations, have garnered interest for their applicability to many downstream tasks -- especially quantized codecs due to their compatibility with large language models. However, unlike text, speech conveys not only linguistic content but also rich paralinguistic features. Encoding these elements in an entangled fashion may be suboptimal, as it limits flexibility. For instance, voice conversion (VC) aims to convert speaker characteristics while preserving the original linguistic content, which requires a disentangled representation. Inspired by VC methods utilizing $k$-means quantization with self-supervised features to disentangle phonetic information, we develop a discrete NAC capable of structured disentanglement. Experimental evaluations show that our approach achieves reconstruction performance on par with conventional NACs that do not explicitly perform disentanglement, while also matching the effectiveness of conventional VC techniques.

  • Meta-learning for physically-constrained neural system identification

    by Ankush Chakrabarty, Gordon Wichern, Vedang M. Deshpande, Abraham P. Vinod, Karl Berntorp, Christopher R. Laughman


  • Open Access

    HASRD: Hierarchical Acoustic and Semantic Representation Disentanglement

    by Amir Hussein, Sameer Khurana, Gordon Wichern, Francois G. Germain, Jonathan Le Roux

    Effective speech representations for spoken language models must balance semantic relevance with acoustic fidelity for high-quality reconstruction. However, existing approaches struggle to achieve both simultaneously. To address this, we introduce Hierarchical Acoustic and Semantic Representation Disentanglement (HASRD, pronounced `hazard'), a framework that factorizes self-supervised learning representations into discrete semantic and acoustic tokens. HASRD assigns the semantic representation to the first codebook, while encoding acoustic residuals in subsequent codebooks. This preserves ASR performance while achieving high-quality reconstruction. Additionally, we enhance HASRD's encoder efficiency, improving ASR performance without compromising reconstruction quality. Compared to SpeechTokenizer, HASRD achieves a 44% relative WER improvement, superior reconstruction quality, and 2x lower bitrate, demonstrating its effectiveness in disentangling acoustic and semantic information.