Santiago De-Luxan-Hernandez
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Santiago De-Luxan-Hernandez has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
Thomas Wiegand
Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, Berlin, Germany
7 shared publicationsDetlev Marpe
Video Coding & Analytics Department, Fraunhofer Heinrich-Hertz-Institute (HHI), Berlin, Germany
6 shared publicationsHeiko Schwarz
Video Coding & Analytics Department, Fraunhofer Heinrich-Hertz-Institute (HHI), Berlin, Germany
5 shared publicationsJackie Ma
Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, Berlin, Germany
2 shared publicationsAdam Wieckowski
Fraunhofer HHI
1 shared publication- Adam Wieckowski
Video Communication and Applications, Fraunhofer HHI, Berlin, Germany
1 shared publication
Latest Publications
- Open Access
- 7 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 30 (5) , 1281-1295
Video Compression Using Generalized Binary Partitioning, Trellis Coded Quantization, Perceptually Optimized Encoding, and Advanced Prediction and Transform Coding
In this paper, we describe a video coding design that enables a higher coding efficiency than the HEVC standard. The proposed video codec follows the design of block-based hybrid video coding, but includes a number of advanced coding tools. A part of the incorporated advanced concepts was developed by the Joint Video Exploration Team, while others are newly proposed. The key aspects of these newly proposed tools are the following. A video frame is subdivided into rectangles of variable size using a binary partitioning with variable split ratios. Three new approaches for generating spatial intra prediction signals are supported: A line-wise application of conventional intra prediction modes, coupled with a mode-dependent processing order, a region-based template matching prediction method and intra prediction modes based on neural networks. For motioncompensated prediction, a multi-hypothesis mode with more than two motion hypotheses can be used. In transform coding, mode dependent combinations of primary and secondary transforms are applied. Moreover, scalar quantization is replaced by trelliscoded quantization and the entropy coding of the quantized transform coefficients is improved. The intra and inter prediction signals can be filtered using an edge-preserving diffusion filter or a non-linear DCT-based thresholding operation. The video codec includes an adaptive in-loop filter for which one of three classifiers can be chosen on a picture basis. We also incorporated an optional encoder control, which adjusts the quantization parameters based on a perceptually motivated distortion measure. In a random access scenario, our proposed video codec achieves luma BD-rate savings between 32.5% for HDR HLG UHD and 39.6% for SDR UHD over the HEVC (HM software) anchor for different categories of test sequences.
- 7 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 30 (5) , 1281-1295
Open AccessVideo Compression Using Generalized Binary Partitioning, Trellis Coded Quantization, Perceptually Optimized Encoding, and Advanced Prediction and Transform Coding
In this paper, we describe a video coding design that enables a higher coding efficiency than the HEVC standard. The proposed video codec follows the design of block-based hybrid video coding, but includes a number of advanced coding tools. A part of the incorporated advanced concepts was developed by the Joint Video Exploration Team, while others are newly proposed. The key aspects of these newly proposed tools are the following. A video frame is subdivided into rectangles of variable size using a binary partitioning with variable split ratios. Three new approaches for generating spatial intra prediction signals are supported: A line-wise application of conventional intra prediction modes, coupled with a mode-dependent processing order, a region-based template matching prediction method and intra prediction modes based on neural networks. For motioncompensated prediction, a multi-hypothesis mode with more than two motion hypotheses can be used. In transform coding, mode dependent combinations of primary and secondary transforms are applied. Moreover, scalar quantization is replaced by trelliscoded quantization and the entropy coding of the quantized transform coefficients is improved. The intra and inter prediction signals can be filtered using an edge-preserving diffusion filter or a non-linear DCT-based thresholding operation. The video codec includes an adaptive in-loop filter for which one of three classifiers can be chosen on a picture basis. We also incorporated an optional encoder control, which adjusts the quantization parameters based on a perceptually motivated distortion measure. In a random access scenario, our proposed video codec achieves luma BD-rate savings between 32.5% for HDR HLG UHD and 39.6% for SDR UHD over the HEVC (HM software) anchor for different categories of test sequences.
- 1 September 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1203-1207
An Intra Subpartition Coding Mode for VVC
The upcoming Versatile Video Coding (VVC) Standard includes various new intra prediction tools that were not present in its predecessor High Efficiency Video Coding (HEVC), such as the wide angle intra prediction, the position dependent prediction combination or the multiple reference line intra prediction. In order to improve the intra prediction coding efficiency, this paper proposes the usage of the Intra Subpartition (ISP) algorithm. ISP is an updated version of the Line-Based Intra Prediction (LIP) mode that improves the trade-off between coding gain and complexity of the original method. The basic principle of ISP consists in subdividing an intra-predicted block into 2 or 4 subpartitions of at least 16 samples according to the original block dimensions. The method has been implemented on top of the VVC Test Model 3.0 (VTM-3.0), with the result of obtaining a gain of 0.57% with encoding and decoding run-times of 112% and 102% respectively for the All Intra configuration and a gain of 0.29% with encoding and decoding run-times of 102% and 101% respectively for the Random Access configuration.
- 1 September 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1203-1207
An Intra Subpartition Coding Mode for VVC
The upcoming Versatile Video Coding (VVC) Standard includes various new intra prediction tools that were not present in its predecessor High Efficiency Video Coding (HEVC), such as the wide angle intra prediction, the position dependent prediction combination or the multiple reference line intra prediction. In order to improve the intra prediction coding efficiency, this paper proposes the usage of the Intra Subpartition (ISP) algorithm. ISP is an updated version of the Line-Based Intra Prediction (LIP) mode that improves the trade-off between coding gain and complexity of the original method. The basic principle of ISP consists in subdividing an intra-predicted block into 2 or 4 subpartitions of at least 16 samples according to the original block dimensions. The method has been implemented on top of the VVC Test Model 3.0 (VTM-3.0), with the result of obtaining a gain of 0.57% with encoding and decoding run-times of 112% and 102% respectively for the All Intra configuration and a gain of 0.29% with encoding and decoding run-times of 102% and 101% respectively for the Random Access configuration.
- 1 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 566
A Hardware-Friendly Extension of Line-Based Intra Prediction for Video Coding
Versatile Video Coding (VVC) is going to be the successor of High Efficiency Video Coding (HEVC). The new standard (currently under development) requires the adoption of tools that provide a good trade-off between gain and implementation complexity. In previous work we proposed a Line-Based Intra Prediction (LIP) algorithm to improve the coding performance of the upcoming standard. However, that contribution did not sufficiently take into account the hardware-related complexity of the method. For this reason, this publication addresses these problems and proposes several modifications of the algorithm to solve them. Experimental results show an average gain of 1.0% and 0.5% for the All Intra (AI) and Random Access (RA) configurations, respectively.
- 1 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 566
A Hardware-Friendly Extension of Line-Based Intra Prediction for Video Coding
Versatile Video Coding (VVC) is going to be the successor of High Efficiency Video Coding (HEVC). The new standard (currently under development) requires the adoption of tools that provide a good trade-off between gain and implementation complexity. In previous work we proposed a Line-Based Intra Prediction (LIP) algorithm to improve the coding performance of the upcoming standard. However, that contribution did not sufficiently take into account the hardware-related complexity of the method. For this reason, this publication addresses these problems and proposes several modifications of the algorithm to solve them. Experimental results show an average gain of 1.0% and 0.5% for the All Intra (AI) and Random Access (RA) configurations, respectively.
- 1 December 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 135-138
Fast Line-Based Intra Prediction for Video Coding
Intra prediction plays a very important role in current video coding technologies like the H.265/High Efficiency Video Coding (HEVC) standard, the Joint Exploration Test Model (JEM) and the upcoming Versatile Video Coding (VVC) standard. In previous work we proposed a Line-Based Intra Prediction algorithm to improve the state-of-art coding performance of HEVC and JEM. This method divides (horizontally or vertically) a block into lines and then it codes each of them individually in a sequential manner. At the encoder side, however, it is necessary to select an optimal combination of intra mode and 1-D split type in a Rate-Distortion sense. Since testing for every block all possible combinations of these two parameters would imply a very significant increase in the encoder complexity, this paper proposes several fast algorithms to reduce the number of tests and improve the overall trade-off between complexity and gain. The experimental results show a reduction of the encoder run-time from 322% to 166% in exchange for a loss of 0.34% for the All Intra configuration and from 151% to 116% for a loss of 0.15% in the case of Random Access.
- 1 December 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 135-138
Fast Line-Based Intra Prediction for Video Coding
Intra prediction plays a very important role in current video coding technologies like the H.265/High Efficiency Video Coding (HEVC) standard, the Joint Exploration Test Model (JEM) and the upcoming Versatile Video Coding (VVC) standard. In previous work we proposed a Line-Based Intra Prediction algorithm to improve the state-of-art coding performance of HEVC and JEM. This method divides (horizontally or vertically) a block into lines and then it codes each of them individually in a sequential manner. At the encoder side, however, it is necessary to select an optimal combination of intra mode and 1-D split type in a Rate-Distortion sense. Since testing for every block all possible combinations of these two parameters would imply a very significant increase in the encoder complexity, this paper proposes several fast algorithms to reduce the number of tests and improve the overall trade-off between complexity and gain. The experimental results show a reduction of the encoder run-time from 322% to 166% in exchange for a loss of 0.34% for the All Intra configuration and from 151% to 116% for a loss of 0.15% in the case of Random Access.
- 1 October 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 221-225
Line-Based Intra Prediction for Next-Generation Video Coding
Intra prediction in modern block-based hybrid video coding standards like H.265/High Efficiency Video Coding (HEVC) extrapolates the reconstructed values of neighboring reference samples of a block to generate the prediction signal. Due to the loss of correlation between samples with increasing distance, this procedure may lead to residual signals with high levels of energy concentrated in the most distant regions of the block relative to the neighboring reference samples. To circumvent this loss in prediction quality with increasing distance and improve the coding efficiency of intra prediction, this publication proposes an algorithm that divides blocks into line-based sub-partitions that are processed individually. This approach has been implemented in the context of HEVC and the new Joint Exploration Test Model (JEM), with the result of obtaining average bit-rate savings of 2.77% and 1.62% for a whole test set of video sequences according to the All Intra and Random Access configurations, respectively.
- 1 October 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 221-225
Line-Based Intra Prediction for Next-Generation Video Coding
Intra prediction in modern block-based hybrid video coding standards like H.265/High Efficiency Video Coding (HEVC) extrapolates the reconstructed values of neighboring reference samples of a block to generate the prediction signal. Due to the loss of correlation between samples with increasing distance, this procedure may lead to residual signals with high levels of energy concentrated in the most distant regions of the block relative to the neighboring reference samples. To circumvent this loss in prediction quality with increasing distance and improve the coding efficiency of intra prediction, this publication proposes an algorithm that divides blocks into line-based sub-partitions that are processed individually. This approach has been implemented in the context of HEVC and the new Joint Exploration Test Model (JEM), with the result of obtaining average bit-rate savings of 2.77% and 1.62% for a whole test set of video sequences according to the All Intra and Random Access configurations, respectively.
- 1 January 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Block adaptive selection of multiple core transforms for video coding
Transform coding tools in video coding have traditionally relied on the Discrete Cosine Transform Type II (DCT-II) to map residual signals to a new domain where quantization and entropy coding tools achieve a better coding efficiency than in the spatial domain. However, the DCT-II is not sufficient to model all different types of residual signals efficiently, especially in the intra-predicted blocks case. For this reason, the DST-VII was introduced in H.265/High Efficiency Video Coding (HEVC) in order to improve the compression performance of 4 × 4 intra-predicted blocks. In this paper we propose a multiple core transform approach, in which each transform is separable and generated by combining two one-dimensional transforms for the vertical and horizontal directions. The pair of 1-D transforms is selected from a set of three different types of Discrete Trigonometric Transforms and the Identity Transformation. Test results show that the proposed algorithm achieves bit rate reductions of 3% on average with respect to HEVC for intra-predicted residuals.
- 1 January 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Block adaptive selection of multiple core transforms for video coding
Transform coding tools in video coding have traditionally relied on the Discrete Cosine Transform Type II (DCT-II) to map residual signals to a new domain where quantization and entropy coding tools achieve a better coding efficiency than in the spatial domain. However, the DCT-II is not sufficient to model all different types of residual signals efficiently, especially in the intra-predicted blocks case. For this reason, the DST-VII was introduced in H.265/High Efficiency Video Coding (HEVC) in order to improve the compression performance of 4 × 4 intra-predicted blocks. In this paper we propose a multiple core transform approach, in which each transform is separable and generated by combining two one-dimensional transforms for the vertical and horizontal directions. The pair of 1-D transforms is selected from a set of three different types of Discrete Trigonometric Transforms and the Identity Transformation. Test results show that the proposed algorithm achieves bit rate reductions of 3% on average with respect to HEVC for intra-predicted residuals.
- 1 September 2015
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 192-195
A kernel-based statistical analysis of the residual error in video coding
Video compression techniques exploit the statistical redundancy present in video signals to efficiently reduce the amount of information sent to the decoder. We contribute with a kernel-based analysis of the residual error blocks. In particular, we borrow dimension reduction techniques from machine learning, namely Principal Component Analysis (PCA) and nonlinear Kernel Principal Component Analysis (KPCA), to assess the spatial structure of block residuals. Interestingly, a nonlinear structure is observed that correlates to the rate-distortion costs of the blocks. Simulations by using a test set of videos with cropped Ultra High Definition (UHD) resolution show interesting results.
- 1 September 2015
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 192-195
A kernel-based statistical analysis of the residual error in video coding
Video compression techniques exploit the statistical redundancy present in video signals to efficiently reduce the amount of information sent to the decoder. We contribute with a kernel-based analysis of the residual error blocks. In particular, we borrow dimension reduction techniques from machine learning, namely Principal Component Analysis (PCA) and nonlinear Kernel Principal Component Analysis (KPCA), to assess the spatial structure of block residuals. Interestingly, a nonlinear structure is observed that correlates to the rate-distortion costs of the blocks. Simulations by using a test set of videos with cropped Ultra High Definition (UHD) resolution show interesting results.