Han Gao
Research Subjects
Research Interests
Han Gao has a total of 59 co-authors. Here are the top co-authors by number of shared publications:
- Shan Liu
Sichuan Provincial Key Laboratory for Human Disease Gene Study, Department of Medical Genetics, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 610072, China
3 shared publications - Eckehard Steinbach
Technical University of Munich Munich Germany
2 shared publications - Jing Ye
Tencent America, LLC (United States)
2 shared publications Semih Esenlik
Huawei Technologies, 80992 Munich, Germany
2 shared publications- Xiang Li
Tencent, Palo Alto, CA, USA
2 shared publications - Xin Zhao
Tencent America, LLC (United States)
2 shared publications
Latest Publications
- 20 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 3971-3981
Video Coding With Cross-Component Sample Offset
Beyond the exploration of traditional spatial, temporal and subjective visual signal redundancy in image and video compression, recent research has focused on leveraging cross-color component redundancy to enhance coding efficiency. Cross-component coding approaches are motivated by the statistical correlations among different color components, such as those in the Y’CbCr color space, where luma (Y) color component typically exhibits finer details than chroma (Cb/Cr) color components. Inspired by previous cross-component coding algorithms, this paper introduces a novel in-loop filtering approach named Cross-Component Sample Offset (CCSO). CCSO utilizes co-located and neighboring luma samples to generate correction signals for both luma and chroma reconstructed samples. It is a multiplication-free, non-linear mapping process implemented using a look-up-table. The input to the mapping is a group of reconstructed luma samples, and the output is an offset value applied on the center luma or co-located chroma sample. Experimental results demonstrate that the proposed CCSO can be applied to both image and video coding, resulting in improved coding efficiency and visual quality. The method has been adopted into an experimental next-generation video codec beyond AV1 developed by the Alliance for Open Media (AOMedia), achieving significant objective coding gains up to 3.5% and 1.8% for PSNR and VMAF quality metrics, respectively, under random access configuration. Additionally, CCSO notably improves the subjective visual quality.
- 20 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 3971-3981
Video Coding With Cross-Component Sample Offset
Beyond the exploration of traditional spatial, temporal and subjective visual signal redundancy in image and video compression, recent research has focused on leveraging cross-color component redundancy to enhance coding efficiency. Cross-component coding approaches are motivated by the statistical correlations among different color components, such as those in the Y’CbCr color space, where luma (Y) color component typically exhibits finer details than chroma (Cb/Cr) color components. Inspired by previous cross-component coding algorithms, this paper introduces a novel in-loop filtering approach named Cross-Component Sample Offset (CCSO). CCSO utilizes co-located and neighboring luma samples to generate correction signals for both luma and chroma reconstructed samples. It is a multiplication-free, non-linear mapping process implemented using a look-up-table. The input to the mapping is a group of reconstructed luma samples, and the output is an offset value applied on the center luma or co-located chroma sample. Experimental results demonstrate that the proposed CCSO can be applied to both image and video coding, resulting in improved coding efficiency and visual quality. The method has been adopted into an experimental next-generation video codec beyond AV1 developed by the Alliance for Open Media (AOMedia), achieving significant objective coding gains up to 3.5% and 1.8% for PSNR and VMAF quality metrics, respectively, under random access configuration. Additionally, CCSO notably improves the subjective visual quality.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 139-147
Advancements in intra prediction techniques beyond AV1 codec
Smooth prediction modes and angular intra prediction modes are two major types of intra prediction modes in AV1 video codec designed to reduce spatial redundancy in video signals. The smooth prediction mode is particularly effective in predicting blocks with a smooth gradient within the block, while angular intra prediction mode predicts pixel values by a weighted average of neighboring pixels along different angular directions within the block. This paper proposes extensions to these modes to improve the intra coding performance towards a next-generation video codec beyond the AV1 codec. The first extension involves refining the smooth modes by considering the geometric distance between each sample and its reference pixels to achieve more precise prediction. The second extension involves refining the distribution of intra prediction angles in AV1 such that the intra prediction angles are denser around vertical and horizontal modes and coarser around diagonal directions. The third extension proposes applying Intra Bi-Prediction (IBP) to a subset of prediction angles, which implicitly allows the codec to choose between IBP on and off case. Experimental results show that the proposed methods achieve up to 0.3% luma and chroma average BD-rate savings with no encoding time increase for all intra configuration when compared to research-v4.0.0 tag of reference software AVM which is developed for exploring next-generation video coding beyond AV1. Notably, the highest coding gain observed was up to 1.5% for 4K video sequences.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 139-147
Advancements in intra prediction techniques beyond AV1 codec
Smooth prediction modes and angular intra prediction modes are two major types of intra prediction modes in AV1 video codec designed to reduce spatial redundancy in video signals. The smooth prediction mode is particularly effective in predicting blocks with a smooth gradient within the block, while angular intra prediction mode predicts pixel values by a weighted average of neighboring pixels along different angular directions within the block. This paper proposes extensions to these modes to improve the intra coding performance towards a next-generation video codec beyond the AV1 codec. The first extension involves refining the smooth modes by considering the geometric distance between each sample and its reference pixels to achieve more precise prediction. The second extension involves refining the distribution of intra prediction angles in AV1 such that the intra prediction angles are denser around vertical and horizontal modes and coarser around diagonal directions. The third extension proposes applying Intra Bi-Prediction (IBP) to a subset of prediction angles, which implicitly allows the codec to choose between IBP on and off case. Experimental results show that the proposed methods achieve up to 0.3% luma and chroma average BD-rate savings with no encoding time increase for all intra configuration when compared to research-v4.0.0 tag of reference software AVM which is developed for exploring next-generation video coding beyond AV1. Notably, the highest coding gain observed was up to 1.5% for 4K video sequences.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 23-172
Wedge mode extensions beyond AV1 video codec
Wedge mode is a crucial compound prediction mode for predicting a block that includes motion object boundaries in the AV1 video codec. The current AV1 design incorporates 16 block shape adaptive modes, utilizing a set of handcrafted one-dimensional blending masks, which are predefined and applied to the blending process of combining two predictors. However, this design lacks flexibility to cater to various types of motion object boundaries in real-world scenarios. This paper proposes an extended wedge mode to replace the original design. The proposed method features novel components such as relaxed block sizes and number of modes limitation, mathematically derived non-linear based two-dimensional masks for the blending process, and more efficient mode signaling methods. The experimental results of the proposed method evaluated with the AOM reference software under the AOM common test conditions demonstrate that it provides an averaged YUV Bjøntegaard Delta rate reduction of 0.3 % for random access and 0.7 % for low delay configurations without a major increase in complexity.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 23-172
Wedge mode extensions beyond AV1 video codec
Wedge mode is a crucial compound prediction mode for predicting a block that includes motion object boundaries in the AV1 video codec. The current AV1 design incorporates 16 block shape adaptive modes, utilizing a set of handcrafted one-dimensional blending masks, which are predefined and applied to the blending process of combining two predictors. However, this design lacks flexibility to cater to various types of motion object boundaries in real-world scenarios. This paper proposes an extended wedge mode to replace the original design. The proposed method features novel components such as relaxed block sizes and number of modes limitation, mathematically derived non-linear based two-dimensional masks for the blending process, and more efficient mode signaling methods. The experimental results of the proposed method evaluated with the AOM reference software under the AOM common test conditions demonstrate that it provides an averaged YUV Bjøntegaard Delta rate reduction of 0.3 % for random access and 0.7 % for low delay configurations without a major increase in complexity.
- 9 November 2022
- Published by Springer Nature
- p. 447-463
Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compression
- 9 November 2022
- Published by Springer Nature
- p. 447-463
Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compression
- Open Access
- 30 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (10) , 3848-3861
Motion Vector Coding and Block Merging in the Versatile Video Coding Standard
This paper overviews the motion vector coding and block merging techniques in the Versatile Video Coding (VVC) standard developed by the Joint Video Experts Team (JVET). In general, inter-prediction techniques in VVC can be classified into two major groups: “whole block-based inter prediction” and “subblock-based inter prediction”. In this paper, we focus on techniques for whole block-based inter prediction. As in its predecessor, High Efficiency Video Coding (HEVC), whole block-based inter prediction in VVC is represented by adaptive motion vector prediction (AMVP) mode or merge mode. Newly introduced features purely for AMVP mode include symmetric motion vector difference and adaptive motion vector resolution. The features purely for merge mode include pairwise average merge, merge with motion vector difference, combined inter-intra prediction and geometric partitioning mode. Coding tools such as history-based motion vector prediction and bidirectional prediction with coding unit weights can be applied on both AMVP mode and merge mode. This paper discusses the design principles and the implementation of the new inter-prediction methods. Using objective metrics, simulation results show that the methods overviewed in the paper can jointly achieve 6.2% and 4.7% BD-rate savings on average with the random access and low-delay configurations, respectively. Significant subjective picture quality improvements of some tools are also reported when comparing the resulting pictures at same bitrates.
- 30 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (10) , 3848-3861
Open AccessMotion Vector Coding and Block Merging in the Versatile Video Coding Standard
This paper overviews the motion vector coding and block merging techniques in the Versatile Video Coding (VVC) standard developed by the Joint Video Experts Team (JVET). In general, inter-prediction techniques in VVC can be classified into two major groups: “whole block-based inter prediction” and “subblock-based inter prediction”. In this paper, we focus on techniques for whole block-based inter prediction. As in its predecessor, High Efficiency Video Coding (HEVC), whole block-based inter prediction in VVC is represented by adaptive motion vector prediction (AMVP) mode or merge mode. Newly introduced features purely for AMVP mode include symmetric motion vector difference and adaptive motion vector resolution. The features purely for merge mode include pairwise average merge, merge with motion vector difference, combined inter-intra prediction and geometric partitioning mode. Coding tools such as history-based motion vector prediction and bidirectional prediction with coding unit weights can be applied on both AMVP mode and merge mode. This paper discusses the design principles and the implementation of the new inter-prediction methods. Using objective metrics, simulation results show that the methods overviewed in the paper can jointly achieve 6.2% and 4.7% BD-rate savings on average with the random access and low-delay configurations, respectively. Significant subjective picture quality improvements of some tools are also reported when comparing the resulting pictures at same bitrates.
- Open Access
- 11 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (10) , 3818-3833
Block Partitioning Structure in the VVC Standard
Versatile Video Coding (VVC) is the latest video coding standard jointly developed by ITU-T VCEG and ISO/IEC MPEG. In this paper, technical details and experimental results for the VVC block partitioning structure are provided. Among all the new technical aspects of VVC, the block partitioning structure is identified as one of the most substantial changes relative to the previous video coding standards and provides the most significant coding gains. The new partitioning structure is designed using a more flexible scheme. Each coding tree unit (CTU) is either treated as one coding unit or split into multiple coding units by one or more recursive quaternary tree partitions followed by one or more recursive multi-type tree splits. The latter can be horizontal binary tree split, vertical binary tree split, horizontal ternary tree split, or vertical ternary tree split. A CTU dual tree for intra-coded slices is described on top of the new block partitioning structure, allowing separate coding trees for luma and chroma. Also, a new way of handling picture boundaries is presented. Additionally, to reduce hardware decoder complexity, virtual pipeline data unit constraints are introduced, which forbid certain multi-type tree splits. Finally, a local dual tree is described, which reduces the number of small chroma intra blocks.
- 11 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (10) , 3818-3833
Open AccessBlock Partitioning Structure in the VVC Standard
Versatile Video Coding (VVC) is the latest video coding standard jointly developed by ITU-T VCEG and ISO/IEC MPEG. In this paper, technical details and experimental results for the VVC block partitioning structure are provided. Among all the new technical aspects of VVC, the block partitioning structure is identified as one of the most substantial changes relative to the previous video coding standards and provides the most significant coding gains. The new partitioning structure is designed using a more flexible scheme. Each coding tree unit (CTU) is either treated as one coding unit or split into multiple coding units by one or more recursive quaternary tree partitions followed by one or more recursive multi-type tree splits. The latter can be horizontal binary tree split, vertical binary tree split, horizontal ternary tree split, or vertical ternary tree split. A CTU dual tree for intra-coded slices is described on top of the new block partitioning structure, allowing separate coding trees for luma and chroma. Also, a new way of handling picture boundaries is presented. Additionally, to reduce hardware decoder complexity, virtual pipeline data unit constraints are introduced, which forbid certain multi-type tree splits. Finally, a local dual tree is described, which reduces the number of small chroma intra blocks.
- 24 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (9) , 3603-3617
Geometric Partitioning Mode in Versatile Video Coding: Algorithm Review and Analysis
This paper presents an overview of the geometric partitioning mode (GPM) algorithm that is a part of the most recent Versatile Video Coding (VVC) standard. The GPM algorithm aims to increase the partitioning precision of moving objects using non-rectangular and asymmetric rectangular partitions on top of the conventional rectangular block partitioning structure of VVC. Novel features of GPM contributing to the increase in coding efficiency and the reduction in encoder and decoder complexity are detailed and analyzed in this paper. Evaluated with VVC test model version 8.0 under the joint video experts team common test conditions, experimental results show that the presented GPM algorithm provides luma Bjøntegaard Delta rate reduction of 0.70% for random access and of 1.55% for low delay with B slices configurations, with roughly 3% to 5% additional encoding time and negligible decoder runtime change. Furthermore, as GPM provides more precise partitions for the boundaries of the moving objects, an improvement of visual quality is seen in GPM coded sequences.
- 24 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (9) , 3603-3617
Geometric Partitioning Mode in Versatile Video Coding: Algorithm Review and Analysis
This paper presents an overview of the geometric partitioning mode (GPM) algorithm that is a part of the most recent Versatile Video Coding (VVC) standard. The GPM algorithm aims to increase the partitioning precision of moving objects using non-rectangular and asymmetric rectangular partitions on top of the conventional rectangular block partitioning structure of VVC. Novel features of GPM contributing to the increase in coding efficiency and the reduction in encoder and decoder complexity are detailed and analyzed in this paper. Evaluated with VVC test model version 8.0 under the joint video experts team common test conditions, experimental results show that the presented GPM algorithm provides luma Bjøntegaard Delta rate reduction of 0.70% for random access and of 1.55% for low delay with B slices configurations, with roughly 3% to 5% additional encoding time and negligible decoder runtime change. Furthermore, as GPM provides more precise partitions for the boundaries of the moving objects, an improvement of visual quality is seen in GPM coded sequences.