Learning-Based Early Transform Skip Mode Decision for VVC Screen Content Coding
- 14 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (10) , 6041-6056
Abstract
One of the design goals of the recently published international video coding standard, Versatile Video Coding (VVC/H.266), is efficient coding of computer-generated video content (commonly referred to as screen content) which exhibits different signal characteristics from the usual camera-captured video (commonly referred as natural content). VVC can perform transform in multiple different ways including skipping the transform itself, which demands much computation for its best selection among many combinatory options. In this paper, we investigate designing a machine-learning-based early transform skip mode decision (ML-TSM) which makes a determination whether or not to skip the transform in an early stage by making a simple classification employing key features designed in such a way to reflect the characteristics of TSM blocks well. Compared with the VVC reference software 14.0, the proposed scheme is verified to reduce computational complexity by 11% and 4% with a Bjontegaard delta bitrate (BDBR) increase of 0.34% and 0.23% respectively under all-intra (AI) and random-access (RA) configurations.Keywords
Funding Information
- IIT (IITP-2023-2020-0-01821)
- Samsung Electronics Company Ltd, System LSI Division
- National Research Foundation (NRF-2020R1A2C2007673)
This publication has 36 references indexed in Scilit:
- Low-Complexity CTU Partition Structure Decision and Fast Intra Mode Decision for Versatile Video CodingIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Efficient kNN Classification With Different Numbers of Nearest NeighborsIEEE Transactions on Neural Networks and Learning Systems, 2017
- Palette Mode Coding in HEVC Screen Content Coding ExtensionIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016
- Adaptive Color-Space Transform in HEVC Screen Content CodingIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016
- Intra Block Copy in HEVC Screen Content Coding ExtensionsIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016
- Overview of the Emerging HEVC Screen Content Coding ExtensionIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Core Transform Design in the High Efficiency Video Coding (HEVC) StandardIEEE Journal of Selected Topics in Signal Processing, 2013
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Estimation of prediction error by using K-fold cross-validationStatistics and Computing, 2009