Decoder-side HEVC quality enhancement with scalable convolutional neural network
Authors:
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 817-822
Abstract
The latest High Efficiency Video Coding (HEVC) has been increasingly used to generate video streams over Internet. However, the decoded HEVC video streams may incur severe quality degradation, especially at low bit-rates. Thus, it is necessary to enhance visual quality of HEVC videos at the decoder side. To this end, we propose in this paper a Decoder-side Scalable Convolutional Neural Network (DS-CNN) approach to achieve quality enhancement for HEVC, which does not require any modification of the encoder. In particular, our DS-CNN approach learns a model of Convo-lutional Neural Network (CNN) to reduce distortion of both I and B/P frames in HEVC. It is different from the existing CNN-based quality enhancement approaches, which only handle intra coding distortion, thus not suitable for B/P frames. Furthermore, a scalable structure is included in our DS-CNN, suchthat the computational complexity of our DS-CNN approach is adjustable to the changing computational resources. Finally, the experimental results show the effectiveness of our DS-CNN approach in enhancing quality for both I and B/P frames of HEVC.Keywords
This publication has 12 references indexed in Scilit:
- High performance loop filter for HEVC2015
- Fully convolutional networks for semantic segmentation2015
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Adaptive non-local means filter for image deblockingSignal Processing: Image Communication, 2013
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Image deblocking via sparse representationSignal Processing: Image Communication, 2012
- Loss-Specific Training of Non-Parametric Image Restoration Models: A New State of the Art2012
- Contour Detection and Hierarchical Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Blocking Artifacts Suppression in Block-Coded Images Using Overcomplete Wavelet RepresentationIEEE Transactions on Circuits and Systems for Video Technology, 2004