End-to-End Neural Video Compression: A Review
Open Access
- 10 April 2025
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Circuits and Systems
- Vol. 6, 120-134
Abstract
The pervasive presence of video content has spurred the development of advanced technologies to manage, process, and deliver high-quality content efficiently. Video compression is crucial in providing high-quality video services under limited network and storage capacities, traditionally achieved through hybrid codecs. However, as these frameworks reach a performance bottleneck with compression gains becoming harder to achieve with conventional methods, Deep Neural Networks (DNNs) offer a promising alternative. By leveraging DNNs’ nonlinear representation capacity, these networks can enhance compression efficiency and visual quality. Neural Video Coding (NVC) has recently received significant attention, with Neural Image Coding models surpassing traditional codecs in compression ratios. Therefore, this survey explores the state-of-the-art in NVC, examining recent works, frameworks, and the potential of this innovative approach to revolutionize video compression. We identify that NVC models have come a long way since the first proposals and currently are on par in compression efficiency with the latest hybrid codec, VVC. Still, many improvements are required to enable the practical usage of NVC, such as hardware-friendly development to enable faster inference and execution on mobile and energy-constrained devices.Keywords
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) Brazilian Research Support Agency
- Conselho Nacional de Desenvolvimento Cientifico e Tecnológico (CNPq) Brazilian Research Support Agency
This publication has 53 references indexed in Scilit:
- C3: High-Performance and Low-Complexity Neural Compression from a Single Image or Video2024
- Neural Video Compression with Diverse Contexts2023
- Motion Information Propagation for Neural Video Compression2023
- CANF-VC: Conditional Augmented Normalizing Flows for Video Compression2022
- ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Coding2022
- Recent trending on learning based video compression: A surveyCognitive Robotics, 2021
- Scale-Space Flow for End-to-End Optimized Video Compression2020
- Learned Image Compression With Discretized Gaussian Mixture Likelihoods and Attention Modules2020
- Optical Flow Estimation Using a Spatial Pyramid Network2017
- Nonlinear principal component analysis using autoassociative neural networksAIChE Journal, 1991