Complexity-guided Slimmable Decoder for Efficient Deep Video Compression
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 14358-14367
Abstract
In this work, we propose the complexity-guided slimmable decoder (cgSlimDecoder) in combination with skip-adaptive entropy coding (SaEC) for efficient deep video compression. Specifically, given the target complexty constraints, in our cgSlimDecoder, we introduce a set of new channel width selection modules to automatically decide the optimal channel width of each slimmable convolution layer. By optimizing the complexity-rate-distortion related objective function to directly learn the parameters of the newly introduced channel width selection modules and other modules in the decoder, our cgSlimDecoder can automatically allocate the optimal numbers of parameters for different types of modules (e.g., motion/residual decoder and the motion compensation network) and simultaneously support multiple complexity levels by using a single learnt decoder instead of multiple decoders. In addition, our proposed SaEC can further accelerate the entropy decoding procedure in both motion and residual decoders by simply skipping the entropy coding process for the elements in the encoded feature maps that are already well-predicted by the hyperprior network. As demonstrated in our comprehensive experiments, our newly proposed methods cgSlimDecoder and SaEC are general and can be readily incorporated into three widely used deep video codecs (i.e., DVC, FVC and DCVC) to significantly improve their coding efficiency with negligible performance drop.Keywords
This publication has 25 references indexed in Scilit:
- Learned Video Compression with Feature-level Residuals2020
- Learned Video Compression2019
- Universally Slimmable Networks and Improved Training Techniques2019
- Learning Image and Video Compression Through Spatial-Temporal Energy Compaction2019
- DVC: An End-To-End Deep Video Compression Framework2019
- Video Enhancement with Task-Oriented FlowInternational Journal of Computer Vision, 2019
- Full Resolution Image Compression with Recurrent Neural Networks2017
- MCL-JCV: A JND-based H.264/AVC video quality assessment dataset2016
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003