CANF-VC: Conditional Augmented Normalizing Flows for Video Compression
Preprint
Abstract
This paper presents an end-to-end learning-based video compression system, termed CANF-VC, based on conditional augmented normalizing flows (CANF). Most learned video compression systems adopt the same hybrid-based coding architecture as the traditional codecs. Recent research on conditional coding has shown the sub-optimality of the hybrid-based coding and opens up opportunities for deep generative models to take a key role in creating new coding frameworks. CANF-VC represents a new attempt that leverages the conditional ANF to learn a video generative model for conditional inter-frame coding. We choose ANF because it is a special type of generative model, which includes variational autoencoder as a special case and is able to achieve better expressiveness. CANF-VC also extends the idea of conditional coding to motion coding, forming a purely conditional coding framework. Extensive experimental results on commonly used datasets confirm the superiority of CANF-VC to the state-of-the-art methods. The source code of CANF-VC is available at https://github.com/NYCU-MAPL/CANF-VC.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- ANFIC: Image Compression Using Augmented Normalizing FlowsIEEE Open Journal of Circuits and Systems, 2021
- Overview of the Versatile Video Coding (VVC) Standard and its ApplicationsIEEE Transactions on Circuits and Systems for Video Technology, 2021
- End-to-End Learnt Image Compression via Non-Local Attention Optimization and Improved Context ModelingIEEE Transactions on Image Processing, 2021
- Learning for Video Compression With Recurrent Auto-Encoder and Recurrent Probability ModelIEEE Journal of Selected Topics in Signal Processing, 2020
- End-to-End Optimized Versatile Image Compression With Wavelet-Like TransformIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- Normalizing Flows: An Introduction and Review of Current MethodsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- An End-to-End Learning Framework for Video CompressionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- Video Enhancement with Task-Oriented FlowInternational Journal of Computer Vision, 2019
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012