A Universal Optimization Framework for Learning-based Image Codec
Open Access
- 25 August 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 20 (1) , 1-19
Abstract
Recently, machine learning-based image compression has attracted increasing interests and is approaching the state-of-the-art compression ratio. But unlike traditional codec, it lacks a universal optimization method to seek efficient representation for different images. In this paper, we develop a plug-and-play optimization framework for seeking higher compression ratio, which can be flexibly applied to existing and potential future compression networks. To make the latent representation more efficient, we propose a novel latent optimization algorithm to adaptively remove the redundancy for each image. Additionally, inspired by the potential of side information for traditional codecs, we introduce side information into our framework, and integrate side information optimization with latent optimization to further enhance the compression ratio. In particular, with the joint side information and latent optimization, we can achieve fine rate control using only single model instead of training different models for different rate-distortion trade-offs, which significantly reduces the training and storage cost to support multiple bit rates. Experimental results demonstrate that our proposed framework can remarkably boost the machine learning-based compression ratio, achieving more than 10% additional bit rate saving on three different representative network structures. With the proposed optimization framework, we can achieve 7.6% bit rate saving against the latest traditional coding standard VVC on Kodak dataset, yielding the state-of-the-art compression ratio.Keywords
This publication has 20 references indexed in Scilit:
- Perceptual based SAO rate-distortion optimization method with a simplified JND model for H.265/HEVCSignal Processing: Image Communication, 2015
- Adaptive Loop Filtering for Video CodingIEEE Journal of Selected Topics in Signal Processing, 2013
- Sample Adaptive Offset in the HEVC StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Video Coding With Rate-Distortion Optimized TransformIEEE Transactions on Circuits and Systems for Video Technology, 2011
- Rate Distortion Optimization for H.264 Interframe Coding: A General Framework and AlgorithmsIEEE Transactions on Image Processing, 2007
- Rate-distortion analysis for H.264/AVC video coding and its application to rate controlIEEE Transactions on Circuits and Systems for Video Technology, 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- An overview of the JPEG 2000 still image compression standardSignal Processing: Image Communication, 2002
- The JPEG still picture compression standardIEEE Transactions on Consumer Electronics, 1992