Learnt Mutual Feature Compression for Machine Vision
Authors:
- 4 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Recently, image coding for machines (ICM) has been playing an important role in facilitating intelligent vision tasks. Unfortunately, the existing ICM methods separately compress features at each scale, neglecting the redundancy across multi-scale features. To address this issue, this paper proposes an end-to-end mutual compression framework for the ICM, such that the compression efficiency can be significantly improved by removing the cross-scale redundancy. Specifically, the proposed framework consists of a mutual feature compression network (MFCNet) and a basic feature compression network (BFCNet). The MFCNet predicts large-scale features from basic small-scale features, such that the large amount of bitrates assigned to compress large-scale features can be saved. Moreover, the BFCNet is proposed to compress small-scale features of high quality by removing spatial and channel-wise redundancy. This guarantees superior performances whilst consuming extremely small amount of bit-rates. The experimental results show that our method achieves 90.10% and 74.97% BD-rate saving against the VVC feature anchor and VVC image anchor that have been recently accepted by the moving picture experts group (MPEG).Keywords
This publication has 11 references indexed in Scilit:
- Overview of the Versatile Video Coding (VVC) Standard and its ApplicationsIEEE Transactions on Circuits and Systems for Video Technology, 2021
- Visual Analysis Motivated Rate-Distortion Model for Image Coding2021
- MSFC: Deep Feature Compression in Multi-Task Network2021
- Image Coding For Machines: an End-To-End Learned Approach2021
- Learned Image Compression With Discretized Gaussian Mixture Likelihoods and Attention Modules2020
- The Open Images Dataset V4International Journal of Computer Vision, 2020
- Lossy Intermediate Deep Learning Feature Compression and Evaluation2019
- Feature Pyramid Networks for Object Detection2017
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- The JPEG still picture compression standardCommunications of the ACM, 1991