Stable Audio Open
Authors:
Top Cited Papers
- 6 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Open generative models are vitally important for the community, allowing for fine-tunes and serving as baselines when presenting new models. However, most current text-to-audio models are private and not accessible for artists and researchers to build upon. Here we describe the architecture and training process of a new open-weights text-to-audio model trained with Creative Commons data. Our evaluation shows that the model’s performance is competitive with the state-of-the-art across various metrics. Notably, the reported FDopenl3 results (measuring the realism of the generations) showcase its potential for high-quality stereo sound synthesis at 44.1kHz.Keywords
This publication has 9 references indexed in Scilit:
- DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic ModelsMachine Intelligence Research, 2025
- AudioLDM 2: Learning Holistic Audio Generation With Self-Supervised PretrainingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- RoFormer: Enhanced transformer with Rotary Position EmbeddingNeurocomputing, 2023
- Scalable Diffusion Models with Transformers2023
- Large-Scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation2023
- Efficient Training of Audio Transformers with Patchout2022
- PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern RecognitionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020
- Fréchet Audio Distance: A Reference-Free Metric for Evaluating Music Enhancement Algorithms2019
- Look, Listen, and Learn More: Design Choices for Deep Audio Embeddings2019