Robust Video List Decoding in Error-Prone Transmission Systems Using a Deep Learning Approach
Open Access
- 18 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 170632-170647
Abstract
This paper introduces a novel deep-learning assisted video list decoding method for error-prone video transmission systems. Unlike traditional list decoding techniques, our proposed system uses a Transformer-based no-reference image quality assessment method to select the highest-scoring reconstructed video candidate after reception. Three new components are defined and used in the Transformer-assisted image quality evaluation metric: neighborhood-based patch fidelity aggregation, discriminant color texture transformation and ranking-constrained penalty loss function.We have also created our own database of non-uniformly distorted images, similar to those that might result from transmission errors, in a High Efficiency Video Coding (HEVC) context. In our specific testing context, our improved Transformer-assisted method has a decision accuracy of 100% for intra-coded image, while, for errors occurring in an inter image, it is 96%. Notably, in the few cases where a wrong choice is made, the selected candidate’s quality remains similar to the intact frame. Code: https://github.com/Yujing0926/Robust-Video-List-Decoding-Using-a-Deep-Learning-Approach.Keywords
Funding Information
- Conseil de Recherches en Sciences Naturelles et en Génie du Canada
- Université Polytechnique Hauts-de-France
This publication has 37 references indexed in Scilit:
- MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment2022
- No-Reference Video Quality Assessment Using Distortion Learning and Temporal AttentionIEEE Access, 2022
- Transformer For Image Quality Assessment2021
- Perceptual Image Quality Assessment with Transformers2021
- Table-Free Multiple Bit-Error Correction Using the CRC SyndromeIEEE Access, 2020
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Convolutional Neural Networks for No-Reference Image Quality Assessment2014
- Making a “Completely Blind” Image Quality AnalyzerIEEE Signal Processing Letters, 2012
- Spatial Error Concealment Based on Edge Visual Clearness for Image/Video CommunicationCircuits, Systems, and Signal Processing, 2012
- Video Compression - From Concepts to the H.264/AVC StandardProceedings of the IEEE, 2005