TWThomas Wiegand

Thomas Wiegand

*This is an algorithmically generated author record based on publicly available information.

Thomas Wiegand has a total of 23 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • On the efficiency of image completion methods for intra prediction in video coding with large block structures

    by Dimitar Doshkov, Oscar Jottrand, Thomas Wiegand, Patrick Ndjiki-Nya

    Intra prediction is a fundamental tool in video coding with hybrid block-based architecture. Recent investigations have shown that one of the most beneficial elements for a higher compression performance in high-resolution videos is the incorporation of larger block structures. Thus in this work, we investigate the performance of novel intra prediction modes based on different image completion techniques in a new video coding scheme with large block structures. Image completion methods exploit the fact that high frequency image regions yield high coding costs when using classical H.264/AVC prediction modes. This problem is tackled by investigating the incorporation of several intra predictors using the concept of Laplace partial differential equation (PDE), Least Square (LS) based linear prediction and the Auto Regressive model. A major aspect of this article is the evaluation of the coding performance in a qualitative (i.e. coding efficiency) manner. Experimental results show significant improvements in compression (up to 7.41 %) by integrating the LS-based linear intra prediction.


  • Distributed Media-Aware Rate Allocation for Video Multicast Over Wireless Networks

    by Xiaoqing Zhu, Thomas Schierl, Thomas Wiegand, Bernd Girod

    A unified optimization framework for rate allocation among multiple video multicast sessions sharing a wireless network is presented. Our framework applies to delivery of both scalable and non-scalable video streams. In both cases, the optimization objective is to minimize the total video distortion of all peers without incurring excessive network utilization. Our system model explicitly accounts for heterogeneity in wireless link capacities, traffic contention among neighboring links, as well as different video rate-distortion (RD) characteristics. The proposed distributed rate allocation scheme leverages cross-layer information exchange between the media access control and application layers to achieve fast convergence at the optimal, media-aware allocation. Performance of the proposed media-aware rate allocation protocol is compared against a heuristic scheme based on TCP-friendly rate control (TFRC). In network simulations of standard-definition video streaming over single or multiple multicast trees, the proposed scheme consistently achieves higher overall video quality than the TFRC-based heuristics. When delivering scalable streams, the flexibility of per-peer rate adaptation inside each multicast tree yields a further slight improvement in overall video quality over multicast of non-scalable streams.


  • The Effect of Depth Compression on Multiview Rendering Quality

    by P. Merkle, Y. Morvan, A. Smolic, D. Farin, K. Muller, P.H.N. de With, T. Wiegand

    This paper presents a comparative study on different techniques for depth-image compression and its implications on the quality of multiview video plus depth virtual view rendering. A novel coding algorithm for depth images that concentrates on their special characteristics, namely smooth regions delineated by sharp edges, is compared to H.264 intra-coding with depth- images. These two coding techniques are evaluated in the context of multiview video plus depth representations, where depth information is used to render virtual intermediate camera views of the scene. Therefore it is important to evaluate the influence of depth-image coding artifacts on the quality of rendered virtual views. The results of this evaluation show, that the coding algorithm specialized on the characteristics of depth images outperforms H.264 intra-coding, although its RD-performance is worse.


  • Compressing Time-Varying Visual Content

    by Karsten Muller, Philipp Merkle, Thomas Wiegand

    This article investigates compression approaches for 3D scene representations, where image and geometry are combined. The approaches exemplified in this article mostly focus on work in which the authors have participated.


  • Multi-View Video Plus Depth Representation and Coding

    by Philipp Merkle, Aljoscha Smolic, Karsten Muller, Thomas Wiegand

    A study on the video plus depth representation for multi-view video sequences is presented. Such a 3D representation enables functionalities like 3D television and free viewpoint video. Compression is based on algorithms for multi-view video coding, which exploit statistical dependencies from both temporal and inter-view reference pictures for prediction of both color and depth data. Coding efficiency of prediction structures with and without inter-view reference pictures is analyzed for multi-view video plus depth data, reporting gains in luma PSNR of up to 0.5 dB for depth and 0.3 dB for color. The main benefit from using a multi-view video plus depth representation is that intermediate views can be easily rendered. Therefore the impact on image quality of rendered arbitrary intermediate views is investigated and analyzed in a second part, comparing compressed multi-view video plus depth data at different bit rates with the uncompressed original.


  • Generic and Robust Video Coding with Texture Analysis and Synthesis

    by Patrick Ndjiki-Nya, Tobias Hinz, Thomas Wiegand

    A video coding approach that uses texture analysis at the encoder and synthesis at the decoder is presented. It is characterized by scaling of texture reconstruction accuracy at the decoder according to perceptual relevance to the viewer. A closed-loop concept is proposed for a fully automated approach that can be integrated into any video codec. Besides texture analysis and synthesis, the loop encompasses a video quality assessor (VQA) that is roughly three times as complex as PSNR and performs as well as significantly more complex standardized perceptual measures. The VQA operates local and global consistency evaluations, where the outcome is utilized to correct segmentation masks provided by the texture analyzer, such that synthesis results can be improved. The proposed method is generic because rigid and non-rigid textures can be handled. Experimental results are presented that show that significant bit-rate gains can be achieved compared to H.264/AVC without our method.


  • Efficient Compression of Multi-View Depth Data Based on MVC

    by Philipp Merkle, Aljoscha Smolic, Karsten Muller, Thomas Wiegand

    This paper presents a method for efficient compression of multi-view depth data based on our multi-view video coding approach for color data. The idea is to exploit statistical dependencies from both temporal and inter-view reference pictures for prediction. For this purpose a multi-view video data set including color and depth information is analyzed in terms of coding efficiency. Coding experiments using prediction structures with and without inter-view reference pictures are performed with multi-view depth data and compared to multi-view video coding. The results show that additionally applying inter-view prediction to temporal prediction with hierarchical B pictures improves coding efficiency for depth as well as color, reporting average gains in PSNR-Y of 0.5 dB for depth and 0.3 dB for color.


  • Efficient Full-Reference Assessment of Image and Video Quality

    by Patrick Ndjiki-Nya, Mikel Barrado, Thomas Wiegand

    Automatic quality assessment of digital pictures is a crucial issue in several image and video processing applications including broadcasting, archiving, or restoration. The visibility of impairments related to digital image processing systems is subject to the spatio-temporal properties of the given image or video content. As quality assessment using subjective tests carried out by humans is very costly, time consuming, and not compatible with real-time constraints, objective measures are required that can predict the perceptual judgment of human viewers. In this paper, a top-down quality assessment tool that mimics a selection of prominent human visual system properties is presented. Quality evaluation is conducted based on perceptually salient feature points in our approach. It is shown that the proposed method, although featuring a significantly lower complexity than standardized quality measures, performs as well as these for block-based hybrid video coding.


  • Distributed Rate-Distortion Optimization for Rateless Coded Scalable Video in Mobile Ad Hoc Networks

    by Thomas Schierl, Stian Johansen, Cornelius Hellge, Thomas Stockhammer, Thomas Wiegand

    Recent advances in forward error correction and scalable video coding enable new approaches for robust, distributed streaming in mobile ad hoc networks (MANETs). This work presents an approach for distribution of real time video by different uncoordinated peer-to-peer relay or source nodes in an overlay network on top of a MANET. The approach proposed here allows for distributed, rate-distortion optimized transmission-rate allocation for competing scalable video streams at relay nodes in the overlay network. Furthermore the approach has the desirable feature of path/source diversity for enhancing reliability in connectivity to serving nodes. Signaling overhead within the overlay network is kept at a minimum, since optimizations are done at relay nodes and clients rather than at servers.


  • Texture Synthesis Method for Generic Video Sequences

    by Patrick Ndjiki-Nya, Christoph Stuber, Thomas Wiegand

    An effective texture synthesis method is presented that is inspired by the work of Kwatra et al. [1]. Their algorithm is non-parametric and patch-based. Blending between overlapping patches is optimized using graph cut techniques. We generalize the initial approach [ 1 ] to achieve a new synthesis algorithm that yields improved results for a much larger class of natural video sequences. For that, two major extensions have been provided: (1) the ability to handle constrained texture synthesis applications and (2) robustness against global camera motion. Constrained synthesis thereby refers to integrating synthetic textures into natural video sequences, as opposed to unconstrained texture synthesis, where (infinite) spatio-temporal extensions of single textures are generated. Camera motion compensation enables applicability of the synthesis algorithm to video sequences with a moving camera. The results presented in this paper show that the proposed improvements yield significant subjective gains compared to the initial algorithm.