Image Error Concealment Based on Deep Neural Network
Open Access
- 19 April 2019
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 12 (4) , 82
Abstract
In this paper, we propose a novel spatial image error concealment (EC) method based on deep neural network. Considering that the natural images have local correlation and non-local self-similarity, we use the local information to predict the missing pixels and the non-local information to correct the predictions. The deep neural network we utilize can be divided into two parts: the prediction part and the auto-encoder (AE) part. The first part utilizes the local correlation among pixels to predict the missing ones. The second part extracts image features, which are used to collect similar samples from the whole image. In addition, a novel adaptive scan order based on the joint credibility of the support area and reconstruction is also proposed to alleviate the error propagation problem. The experimental results show that the proposed method can reconstruct corrupted images effectively and outperform the compared state-of-the-art methods in terms of objective and perceptual metrics.Keywords
Funding Information
- National Natural Science Foundation of China (11572084,11472061)
- Fundamental Research Funds for the Central Universities (16D110412,17D110408)
- DHU Distinguished Young Professor Program (18D210402)
This publication has 30 references indexed in Scilit:
- Application of GRNN neural network in non-texture image inpainting and restorationPattern Recognition Letters, 2015
- Kernel-Based MMSE Multimedia Signal Reconstruction and Its Application to Spatial Error ConcealmentIEEE Transactions on Multimedia, 2014
- Spatial Error Concealment Based on Edge Visual Clearness for Image/Video CommunicationCircuits, Systems, and Signal Processing, 2012
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Content-adaptive spatial error concealment for video communicationIEEE Transactions on Consumer Electronics, 2004
- An Edge-Oriented Spatial Interpolation for Consecutive Block Error ConcealmentIEEE Signal Processing Letters, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A cell-loss concealment technique for MPEG-2 coded videoIEEE Transactions on Circuits and Systems for Video Technology, 2000
- Geometric-structure-based error concealment with novel applications in block-based low-bit-rate codingIEEE Transactions on Circuits and Systems for Video Technology, 1999
- Concealment of damaged block transform coded images using projections onto convex setsIEEE Transactions on Image Processing, 1995