Two-Step Fast Mode Decision for Intra Coding of Screen Content
- 18 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 32 (8) , 5608-5622
Abstract
With the rapid development of screen content video applications, screen content coding (SCC) is urgently needed to be used in commercial codecs. However, the extra encoding complexity introduced by the new SCC tools has posed a great challenge for its practical deployment. In this paper, motivated by our observations that there should be a fine-grained mapping between image content and candidate modes, we propose a two-step fast mode decision method to reduce the encoding complexity. First, we propose to use a convolution neural network (CNN) to automatically extract useful features for fine-grained content classification. Second, we build a precise and concise mapping from CUs to candidate modes by simultaneously considering CU content type, CU size, and mode complexity. Note that the spatial correlations between neighboring CUs and current CU are also utilized in candidate modes derivation. In addition to the two-step fast mode decision method, a content-aware early termination algorithm is further proposed to reduce the encoding complexity. Extensive experiments demonstrate that our method achieves better performance compared with state-of-the-art ones, with 50.13% total encoding complexity reduction and only 0.92% BD-rate increase.Keywords
Funding Information
- National Natural Science Foundation of China (62171429, 62021001)
- University of Science and Technology of China (USTC) Research Funds of the Double First-Class Initiative (YD3490002001)
- Graphics Processing Unit (GPU) Cluster Built by Multimedia Computing and Communication (MCC) Laboratory of Information Science and Technology Institution, USTC
This publication has 34 references indexed in Scilit:
- Intra Line Copy for HEVC Screen Content Intra-Picture PredictionIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Fast intra mode decision and block matching for HEVC screen content compression2016
- Fast CU partition decision using machine learning for screen content compression2015
- Rotate intra block copy for still image coding2015
- Symmetric intra block copy in video coding2015
- Intra block copy masking2015
- Fast intra partition algorithm for HEVC screen content coding2014
- Exploiting inter-layer correlations in scalable HEVC for the support of screen content videos2014
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003