Brian McFee
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Brian McFee has a total of 74 co-authors. Here are the top co-authors by number of shared publications:
Gert Lanckriet
Department of Electrical and Computer Engineering, University of California, San Diego
7 shared publicationsDaniel P.W. Ellis
Department of Engineering Mathematics University of Bristol || Silicon Valley AI Lab Baidu Inc
4 shared publicationsJuan Pablo Bello
4 shared publicationsCarolina Galleguillos
Computer Science and Engineering Department
3 shared publications- Juan Pablo Bello
Music and Audio Research Lab New York University
3 shared publications - Justin Salamon
Adobe Research, San Francisco, CA, USA
3 shared publications
Latest Publications
- 13 February 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 21-35
RWC Revisited: Towards a Community-Driven MIR Corpus
- 13 February 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 21-35
RWC Revisited: Towards a Community-Driven MIR Corpus
- Open Access
- 7 January 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 179-193
The Vocal Eras Tour: Microtiming Trends Across Decades and Genres
Recent advancements in audio processing have enabled large-scale, quantitative analysis of musical trends. While previous research has explored changes in music over time, the evolution of vocal performance characteristics remains underexplored. In this work, we analyze the microtiming of 88,357 vocal tracks from popular songs spanning 45 years (1965–2010). Using source-separated vocal stems, we analyze vocal timing deviations in songs with a duple metrical structure at both the beat (quarter-note) and beat subdivision (16th-note) levels. We identify vocal onsets to study microtiming deviations. Through statistical analysis, we find significant differences in microtiming between musical genres, as well as trends over time. Our analysis reveals that Rap music has the greatest number of vocal onsets on average, generally arriving later than those of other genres. Across the other genres, singers tend to anticipate the beat, especially on beats 1 and 3. However, these entries have shifted closer to metrical targets over time, possibly reflecting the influence of digital editing tools and evolving listener preferences. Our findings demonstrate the utility of quantitative analysis methods for studying vocal timing and contribute new insights to the understanding of how singing voice recordings have evolved in popular music. We believe these methods have the potential to be applied to the study of other instruments and more diverse musical styles.
- 7 January 2026
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 9 (1) , 179-193
Open AccessThe Vocal Eras Tour: Microtiming Trends Across Decades and Genres
Recent advancements in audio processing have enabled large-scale, quantitative analysis of musical trends. While previous research has explored changes in music over time, the evolution of vocal performance characteristics remains underexplored. In this work, we analyze the microtiming of 88,357 vocal tracks from popular songs spanning 45 years (1965–2010). Using source-separated vocal stems, we analyze vocal timing deviations in songs with a duple metrical structure at both the beat (quarter-note) and beat subdivision (16th-note) levels. We identify vocal onsets to study microtiming deviations. Through statistical analysis, we find significant differences in microtiming between musical genres, as well as trends over time. Our analysis reveals that Rap music has the greatest number of vocal onsets on average, generally arriving later than those of other genres. Across the other genres, singers tend to anticipate the beat, especially on beats 1 and 3. However, these entries have shifted closer to metrical targets over time, possibly reflecting the influence of digital editing tools and evolving listener preferences. Our findings demonstrate the utility of quantitative analysis methods for studying vocal timing and contribute new insights to the understanding of how singing voice recordings have evolved in popular music. We believe these methods have the potential to be applied to the study of other instruments and more diverse musical styles.
- Open Access
Skip That Beat: Augmenting Meter Tracking Models for Underrepresented Time Signatures
Beat and downbeat tracking models are predominantly developed using datasets with music in 4/4 meter, which decreases their generalization to repertories in other time signatures, such as Brazilian samba which is in 2/4. In this work, we propose a simple augmentation technique to increase the representation of time signatures beyond 4/4, namely 2/4 and 3/4. Our augmentation procedure works by removing beat intervals from 4/4 annotated tracks. We show that the augmented data helps to improve downbeat tracking for underrepresented meters while preserving the overall performance of beat tracking in two different models. We also show that this technique helps improve downbeat tracking in an unseen samba dataset.
Open AccessSkip That Beat: Augmenting Meter Tracking Models for Underrepresented Time Signatures
Beat and downbeat tracking models are predominantly developed using datasets with music in 4/4 meter, which decreases their generalization to repertories in other time signatures, such as Brazilian samba which is in 2/4. In this work, we propose a simple augmentation technique to increase the representation of time signatures beyond 4/4, namely 2/4 and 3/4. Our augmentation procedure works by removing beat intervals from 4/4 annotated tracks. We show that the augmented data helps to improve downbeat tracking for underrepresented meters while preserving the overall performance of beat tracking in two different models. We also show that this technique helps improve downbeat tracking in an unseen samba dataset.
- Open Access
Sound Scene Synthesis at the DCASE 2024 Challenge
This paper presents Task 7 at the DCASE 2024 Challenge: sound scene synthesis. Recent advances in sound synthesis and generative models have enabled the creation of realistic and diverse audio content. We introduce a standardized evaluation framework for comparing different sound scene synthesis systems, incorporating both objective and subjective metrics. The challenge attracted four submissions, which are evaluated using the Fréchet Audio Distance (FAD) and human perceptual ratings. Our analysis reveals significant insights into the current capabilities and limitations of sound scene synthesis systems, while also highlighting areas for future improvement in this rapidly evolving field.
Open AccessSound Scene Synthesis at the DCASE 2024 Challenge
This paper presents Task 7 at the DCASE 2024 Challenge: sound scene synthesis. Recent advances in sound synthesis and generative models have enabled the creation of realistic and diverse audio content. We introduce a standardized evaluation framework for comparing different sound scene synthesis systems, incorporating both objective and subjective metrics. The challenge attracted four submissions, which are evaluated using the Fréchet Audio Distance (FAD) and human perceptual ratings. Our analysis reveals significant insights into the current capabilities and limitations of sound scene synthesis systems, while also highlighting areas for future improvement in this rapidly evolving field.
- 20 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 32 (23299290) , 2141-2152
Self-Supervised Learning of Multi-Level Audio Representations for Music Segmentation
The task of music structure analysis refers to automatically identifying the location and the nature of musical sections within a song. In the supervised scenario, structural annotations generally result from exhaustive data collection processes, which represents one of the main challenges of this task. Moreover, both the subjectivity of music structure and the hierarchical characteristics it exhibits make the obtained structural annotations not fully reliable, in the sense that they do not convey a “universal ground-truth” unlike other tasks in music information retrieval. On the other hand, the quickly growing quantity of available music data has enabled weakly supervised and self-supervised approaches to achieve impressive results on a wide range of music-related problems. In this work, a self-supervised learning method is proposed to learn robust multi-level music representations prior to structural segmentation using contrastive learning. To this end, sets of frames sampled at different levels of detail are used to train a deep neural network in a disentangled manner. The proposed method is evaluated on both flat and multi-level segmentation. We show that each distinct sub-region of the output embeddings can efficiently account for structural similarity at their own targeted level of detail, which ultimately improves performance of downstream flat and multi-level segmentation. Finally, complementary experiments are carried out to study how the obtained representations can be further adapted to specific datasets using a supervised fine-tuning objective in order to facilitate structure retrieval in domains where human annotations remain scarce.
- 20 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 32 (23299290) , 2141-2152
Self-Supervised Learning of Multi-Level Audio Representations for Music Segmentation
The task of music structure analysis refers to automatically identifying the location and the nature of musical sections within a song. In the supervised scenario, structural annotations generally result from exhaustive data collection processes, which represents one of the main challenges of this task. Moreover, both the subjectivity of music structure and the hierarchical characteristics it exhibits make the obtained structural annotations not fully reliable, in the sense that they do not convey a “universal ground-truth” unlike other tasks in music information retrieval. On the other hand, the quickly growing quantity of available music data has enabled weakly supervised and self-supervised approaches to achieve impressive results on a wide range of music-related problems. In this work, a self-supervised learning method is proposed to learn robust multi-level music representations prior to structural segmentation using contrastive learning. To this end, sets of frames sampled at different levels of detail are used to train a deep neural network in a disentangled manner. The proposed method is evaluated on both flat and multi-level segmentation. We show that each distinct sub-region of the output embeddings can efficiently account for structural similarity at their own targeted level of detail, which ultimately improves performance of downstream flat and multi-level segmentation. Finally, complementary experiments are carried out to study how the obtained representations can be further adapted to specific datasets using a supervised fine-tuning objective in order to facilitate structure retrieval in domains where human annotations remain scarce.
- Open Access
Foley Sound Synthesis at the DCASE 2023 Challenge
The addition of Foley sound effects during post-production is a common technique used to enhance the perceived acoustic properties of multimedia content. Traditionally, Foley sound has been produced by human Foley artists, which involves manual recording and mixing of sound. However, recent advances in sound synthesis and generative models have generated interest in machine-assisted or automatic Foley synthesis techniques. To promote further research in this area, we have organized a challenge in DCASE 2023: Task 7 - Foley Sound Synthesis. Our challenge aims to provide a standardized evaluation framework that is both rigorous and efficient, allowing for the evaluation of different Foley synthesis systems. We received 17 submissions, and performed both objective and subjective evaluation to rank them according to three criteria: audio quality, fit-to-category, and diversity. Through this challenge, we hope to encourage active participation from the research community and advance the state-of-the-art in automatic Foley synthesis. In this technical report, we provide a detailed overview of the Foley sound synthesis challenge, including task definition, dataset, baseline, evaluation scheme and criteria, challenge result, and discussion.
Open AccessFoley Sound Synthesis at the DCASE 2023 Challenge
The addition of Foley sound effects during post-production is a common technique used to enhance the perceived acoustic properties of multimedia content. Traditionally, Foley sound has been produced by human Foley artists, which involves manual recording and mixing of sound. However, recent advances in sound synthesis and generative models have generated interest in machine-assisted or automatic Foley synthesis techniques. To promote further research in this area, we have organized a challenge in DCASE 2023: Task 7 - Foley Sound Synthesis. Our challenge aims to provide a standardized evaluation framework that is both rigorous and efficient, allowing for the evaluation of different Foley synthesis systems. We received 17 submissions, and performed both objective and subjective evaluation to rank them according to three criteria: audio quality, fit-to-category, and diversity. Through this challenge, we hope to encourage active participation from the research community and advance the state-of-the-art in automatic Foley synthesis. In this technical report, we provide a detailed overview of the Foley sound synthesis challenge, including task definition, dataset, baseline, evaluation scheme and criteria, challenge result, and discussion.
- 22 November 2021
- Published by Springer Nature
- p. 927-971
Music Recommendation Systems: Techniques, Use Cases, and Challenges
- 22 November 2021
- Published by Springer Nature
- p. 927-971
Music Recommendation Systems: Techniques, Use Cases, and Challenges
- Open Access
- 29 June 2021
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 4 (1) , 81-92
Automatic Hierarchy Expansion for Improved Structure and Chord Evaluation
- 29 June 2021
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 4 (1) , 81-92
Open AccessAutomatic Hierarchy Expansion for Improved Structure and Chord Evaluation
- 28 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 38 (3) , 73-84
Interactive Learning of Signal Processing Through Music: Making Fourier Analysis Concrete for Students
In this artaicle, we illustrate how music may serve as a vehicle to support education in signal processing. Using Fourier analysis as a concrete example, we demonstrate how the music domain provides motivating and tangible applications that make learning signal processing an interactive pursuit. Furthermore, we indicate how software tools, originally developed for music analysis, provide students multiple entry points to delve deeper into classical signal processing techniques while bridging the gap between education and cutting-edge research.
- 28 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 38 (3) , 73-84
Interactive Learning of Signal Processing Through Music: Making Fourier Analysis Concrete for Students
In this artaicle, we illustrate how music may serve as a vehicle to support education in signal processing. Using Fourier analysis as a concrete example, we demonstrate how the music domain provides motivating and tangible applications that make learning signal processing an interactive pursuit. Furthermore, we indicate how software tools, originally developed for music analysis, provide students multiple entry points to delve deeper into classical signal processing techniques while bridging the gap between education and cutting-edge research.
- Open Access
- 11 December 2020
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 3 (1) , 246-263
Audio-Based Music Structure Analysis: Current Trends, Open Challenges, and Applications
- 11 December 2020
- Published by Ubiquity Press, Ltd. in Transactions of the International Society for Music Information Retrieval
- Vol. 3 (1) , 246-263
Open AccessAudio-Based Music Structure Analysis: Current Trends, Open Challenges, and Applications