Toward Efficient Video Compression Artifact Detection and Removal: A Benchmark Dataset
- 3 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 10816-10827
Abstract
Video compression leads to compression artifacts, among which Perceivable Encoding Artifacts (PEAs) degrade user perception. Most of existing state-of-the-art Video Compression Artifact Removal (VCAR) methods indiscriminately process all artifacts, thus leading to over-enhancement in non-PEA regions. Therefore, accurate detection and location of PEAs is crucial. In this paper, we propose the largest-ever Fine-grained PEA database (FPEA). First, we employ the popular video codecs, VVC and AVS3, as well as their common test settings, to generate four types of spatial PEAs (blurring, blocking, ringing and color bleeding) and two types of temporal PEAs (flickering and floating). Second, we design a labeling platform and recruit sufficient subjects to manually locate all the above types of PEAs. Third, we propose a voting mechanism and feature matching to synthesize all subjective labels to obtain the final PEA labels with fine-grained locations. Besides, we also provide Mean Opinion Score (MOS) values of all compressed video sequences. Experimental results show the effectiveness of FPEA database on both VCAR and compressed Video Quality Assessment (VQA). We envision that FPEA database will benefit the future development of VCAR, VQA and perception-aware video encoders. The FPEA database has been made publicly available.Keywords
Funding Information
- National Natural Science Foundation of China (62171134)
- Natural Science Foundation and Technology Innovation Joint Fund Project of Fujian Province (2023J01395, 2023Y9346)
This publication has 49 references indexed in Scilit:
- Neural Compression-Based Feature Learning for Video Restoration2022
- Recovery of image and video based on compressive sensing via tensor approximation and Spatio-temporal correlationMultimedia Tools and Applications, 2020
- Early Exit or Not: Resource-Efficient Blind Quality Enhancement for Compressed Images2020
- An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysisSignal, Image and Video Processing, 2019
- AVC, HEVC, VP9, AVS2 or AV1? — A Comparative Study of State-of-the-Art Video Encoders on 4K Videos2019
- Discovering Visual Patterns in Art Collections With Spatially-Consistent Feature Learning2019
- Learning Image and Video Compression Through Spatial-Temporal Energy Compaction2019
- The Perception-Distortion Tradeoff2018
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Multiscale structural similarity for image quality assessment2004