Low-Bitrate Redundancy Coding of Speech Using A Rate-Distortion-Optimized Variational Autoencoder
Authors:
- 4 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Robustness to packet loss is one of the main ongoing challenges in real-time speech communication. Deep packet loss concealment (PLC) techniques have recently demonstrated improved quality compared to traditional PLC. Despite that, all PLC techniques hit fundamental limitations when too much acoustic information is lost. To reduce losses in the first place, data is commonly sent multiple times using various redundancy mechanisms. We propose a neural speech coder specifically optimized to transmit a large amount of overlapping redundancy at a very low bitrate, up to 50x redundancy using less than 32 kb/s. Results show that the proposed redundancy is more effective than the existing Opus codec redundancy, and that the two can be combined for even greater robustness.Keywords
This publication has 15 references indexed in Scilit:
- Enhancing into the Codec: Noise Robust Speech Coding with Vector-Quantized Autoencoders2021
- Nonlinear Transform CodingIEEE Journal of Selected Topics in Signal Processing, 2020
- An Open Source Implementation of ITU-T Recommendation P.808 with Validation2020
- Developing an Open-Source Corpus of Yoruba Speech2020
- LPCNET: Improving Neural Speech Synthesis through Linear Prediction2019
- Wavenet Based Low Rate Speech Coding2018
- Rapid Development of TTS Corpora for Four South African Languages2017
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- Efficient scalar quantization of exponential and Laplacian random variablesIEEE Transactions on Information Theory, 1996
- A pyramid vector quantizerIEEE Transactions on Information Theory, 1986