Libriheavy: A 50,000 Hours ASR Corpus with Punctuation Casing and Context
Authors:
Top Cited Papers
- 14 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 10991-10995
Abstract
In this paper, we introduce Libriheavy, a large-scale ASR corpus consisting of 50,000 hours of read English speech derived from LibriVox. To the best of our knowledge, Libriheavy is the largest freely-available corpus of speech with supervisions. Different from other open-sourced datasets that only provide normalized transcriptions, Libriheavy contains richer information such as punctuation, casing and text context, which brings more flexibility for system building. Specifically, we propose a general and efficient pipeline to locate, align and segment the audios in previously published Librilight to its corresponding texts. The same as Librilight, Libriheavy also has three training subsets small, medium, large of the sizes 500h, 5000h, 50000h respectively. We also extract the dev and test evaluation sets from the aligned audios and guarantee there is no overlapping speakers and books in training sets. Baseline systems are built on the popular CTC-Attention and transducer models. Additionally, we open-source our dataset creatation pipeline which can also be used to other audio alignment tasks.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Fast and Parallel Decoding for Transducer2023
- Context-Aware end-to-end ASR Using Self-Attentive Embedding and Tensor Fusion2023
- Attentive Contextual Carryover for Multi-Turn End-to-End Spoken Language Understanding2021
- Libri-Light: A Benchmark for ASR with Limited or No Supervision2020
- Rnn-Transducer with Stateless Prediction Network2020
- Hybrid CTC/Attention Architecture for End-to-End Speech RecognitionIEEE Journal of Selected Topics in Signal Processing, 2017
- Librispeech: An ASR corpus based on public domain audio books2015
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionIEEE Transactions on Audio, Speech, and Language Processing, 2011
- Linear work suffix array constructionJournal of the ACM, 2006
- Connectionist temporal classification2006