BBBenjamin Bross

Benjamin Bross

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Benjamin Bross has a total of 53 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Multi-level Inter-frame Parallelization in an Open Optimized VVC Encoder

    by Valeri George, Jens Brandenburg, Gabriel Hege, Tobias Hinz, Adam Wieckowski, Benjamin Bross, Thomas Schierl, Detlev Marpe

    This work investigates video encoding parallelization techniques based on the Versatile Video Coding (VVC) standard, using the open and optimized encoder software implementation VVenC. Modern multi-processor systems offer significant opportunities for accelerating video encoding. By employing a proposed combination of parallelization methods, the VVenC encoder achieves an acceleration factor of up to 22 compared to single-threaded mode on a 32-core system, with potential increases to 27× at higher bitrates. Building upon prior work on Inter-frame Parallelization (IFP), the study introduces frame region-based synchronization, enabling further acceleration of up to 10%. Beyond that, the study demonstrates extending frame parallelization beyond Group of Pictures (GOP) boundaries, which improves IFP speed up by 37% and 11% at high-definition (HD) and ultra-high-definition (UHD) resolutions, respectively. Additional combinations with other VVC parallelization tools, such as tiles and VVC Wavefront Parallel Processing (WPP), are also explored. The article provides a comprehensive analysis of parallelization challenges and highlights areas for further improvement.


  • Open Access

    Inter-Frame Parallelization in an Open Optimized VVC Encoder

    by Valeri George, Jens Brandenburg, Gabriel Hege, Tobias Hinz, Adam Wieckowski, Benjamin Bross, Thomas Schierl, Detlev Marpe

    The Versatile Video Coding (VVC) standard promises high compression efficiency for diverse content types. Based on VVenC, an open and optimized VVC software video encoder, this work presents an inter-frame parallelization (IFP) method designed to exploit the processing power of modern platforms featuring a high number of computing cores. Encoding an ultrahigh definition video on a 32-core machine with the VVenC's faster preset, the proposed method shows more than 20% increase in encoder speed while only a 1% decrease in compression efficiency compared to the default multi-threading mode. In comparison to single-threaded mode, it corresponds to a speedup factor of 18, up from 15x achievable with the previous parallelization scheme. Furthermore, the synergy of the developed inter-frame parallelization technique with other parallelization methods is explored, including tiles and VVC wavefront parallel processing (WPP). The combination of these approaches enables a notable speedup factor of 21, albeit with a trade-off in coding efficiency. With a focus on VVC, this research contributes to the ongoing discourse on video coding optimization, providing valuable insights into possible pitfalls and the potential gains achievable through efficient parallelization techniques on high-core platforms.


  • Open Access

    Quality-Aware Dynamic Resolution Adaptation Framework for Adaptive Video Streaming

    by Amritha Premkumar, Prajit T. Rajendran, Vignesh V. Menon, Adam Wieckowski, Benjamin Bross, Detlev Marpe

    Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. XPSNR is observed to correlate better with the subjective quality of VVC-coded bitstreams. Towards this realization, we predict the average XPSNR of VVC-coded bitstreams using spatiotemporal complexity features of the video and the target encoding configuration using an XGBoost-based model. Based on the predicted XPSNR scores, we introduce a Quality-Aware Dynamic Resolution Adaptation (QADRA) framework for adaptive video streaming applications, where we determine the convex-hull online. Furthermore, keeping the encoding and decoding times within an acceptable threshold is mandatory for smooth and energy-efficient streaming. Hence, QADRA determines the encoding resolution and quantization parameter (QP) for each target bitrate by maximizing XPSNR while constraining the maximum encoding and/ or decoding time below a threshold. QADRA implements a JND-based representation elimination algorithm to remove perceptually redundant representations from the bitrate ladder. QADRA is an open-source Python-based framework published under the GNU GPLv3 license. Github: https://github.com/PhoenixVideo/QADRA Online documentation: https://phoenixvideo.github.io/QADRA/


  • Open Access

    MC-IF VVC technical guidelines

    by Lukasz Litwic, Benjamin Bross, Alan Stein

  • Open Access

    Review and evaluation of VVC fast partitioning search methods using a common baseline

    by Adam Wieckowski, Anastasia Henkel, Benjamin Bross, Heiko Schwarz, Detlev Marpe

    An important new tool in Versatile Video Coding (VVC) is the extended block partitioning scheme. It enables recursive block subdivisions with five different split modes. This flexibility largely contributes to VVC's compression performance, but also increases the encoder complexity. There have been many methods proposed in the literature to speed up the partitioning search in VVC encoders, from simple heuristics to complex approaches based on neural networks. This paper intends to review this literature and compare it to a simple complexity reduction technique, namely progressive reduction of available split-depths. For each reviewed paper, a working point is found that roughly matches either the shown runtime reduction or bitrate increase. Our proposed method produces a variety of working points with its convex hull including the operating points of many approaches discussed in the literature. Only half of the reviewed works slightly outperform the envelope of proposed working points. This review and performance evaluation study intends to put into perspective known VVC encoder optimization research from literature when compared to our proposed common baseline method that may serve as a benchmark for future work in this area.


  • Open Access

    Energy-efficient Adaptive Video Streaming with Latency-Aware Dynamic Resolution Encoding

    by Vignesh V. Menon, Amritha Premkumar, Prajit T. Rajendran, Adam Wieckowski, Benjamin Bross, Christian Timmerer, Detlev Marpe

    Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. However, keeping the encoding time within an acceptable threshold for a smooth user experience is important to reduce the carbon footprint and energy consumption on encoding servers in video streaming applications. Toward this realization, we introduce an encoding latency-aware dynamic resolution encoding scheme (LADRE) for adaptive video streaming applications. LADRE determines the encoding resolution for each target bitrate by utilizing a random forest-based prediction model for every video segment based on spatiotemporal features and the acceptable target latency. Experimental results show that LADRE achieves an overall average quality improvement of 0.58 dB PSNR and 0.43 dB XPSNR while maintaining the same bitrate, compared to the HTTP Live Streaming (HLS) bitrate ladder encoding of 200 s segments using the VVenC encoder, when the encoding latency for each representation is set to remain below the 200 s threshold. This is accompanied by a 84.17% reduction in overall encoding energy consumption.


  • Open Access

    Gain of Grain

    by Vignesh V. Menon, Adam Wieckowski, Jens Brandenburg, Benjamin Bross, Thomas Schierl, Detlev Marpe

    Film grain is a distinctive visual characteristic cherished by filmmakers and cinephiles for its ability to evoke nostalgia and artistic aesthetics. However, faithful preservation of film grain during encoding poses unique challenges. Film grain introduces random noise, complicating traditional compression techniques. Consequently, specialized algorithms and encoding strategies have emerged, aiming to strike a harmonious equilibrium. This paper delves into the nuanced realm of film grain handling in Versatile Video Coding (VVC) encoding. We explore the delicate balance between retaining the cinematic charm of film grain and achieving efficient compression. Moreover, we discuss the importance of perceptual quality assessment and adaptive encoding techniques in preserving film grain fidelity. Additionally, we delve into the impact of film grain handling on bitrate control and compression efficiency using VVenC, an open and optimized VVC encoder. Understanding the role of film grain and its nuanced treatment within encoders becomes increasingly pivotal for delivering high-quality, grain-inclusive content in the digital age.


  • Efficient VVC Encoding Using Hierarchical Parallelization: A Comprehensive Analysis

    by Valeri George, Jens Brandenburg, Gabriel Hege, Tobias Hinz, Adam Wieckowski, Benjamin Bross, Detlev Marpe

    This paper presents and analyzes different parallelization strategies in VVenC, an open and optimized software encoder implementation of the Versatile Video Coding (VVC) standard. VVC has been developed to address the increasing demand for higher compression of digital video data, and it reduces the bitrate by around 50% for the same perceived quality compared to its predecessor, the High-Efficiency Video Coding (HEVC) standard. However, this increase in compression efficiency comes with an increase in computational complexity, particularly on the encoder side. VVenC integrates algorithmic optimizations for each coding tool in VVC and defines a set of five presets from faster to slower that provide Pareto-optimal tradeoffs between runtime and efficiency. Multithreading is employed to further reduce runtime while preserving most of the compression efficiency of each preset. With a hierarchical combination of pre-processing, picture-level and in-picture parallelization, VVenC achieves a 4× speedup for four threads. Further speedup using a higher number of threads depends on the video resolution and used encoder preset. For 16 threads, it ranges from 6 to 9 for high definition to 10-12 for ultra-high-definition video. Compared to previous work, the usage of temporal prediction for the adaptive loop filter reduces the associated coding efficiency loss from 0.4% to almost zero. A better scaling for higher numbers of threads can be achieved at the cost of a higher coding efficiency loss. In the presented framework, increased speedup by smaller block Coding Tree Unit (CTU) sizes, a combination of wavefront parallel processing and various tiles picture partitioning configurations is examined. Furthermore, results on a 20-core ARM-based Apple M1 computer indicate a better scaling for multithreading compared to × 86-based architectures. The analysis is complemented by profiling, which exhibits the overhead by idle threads and identifies the mode estimation as the main bottleneck of the presented framework.


  • Open Access

    Open and optimized VVC Implementations on ARM Architectures

    by Benjamin Bross, Christian Lehmann, Gabriel Hege, Adam Wieckowski, Detlev Marpe

    The international video coding standard Versatile Video Coding (VVC) has been finalized in July 2020 by ITU-T and ISO/IEC. In September 2020, the open and optimized VVC encoder (VVenC) and decoder (VVdeC) software has been released and continuously improved in terms of speed and efficiency. Originally developed for x86 architecture, recent optimizations on vectorization target ARM platforms. VVenC and VVdeC runtimes have been measured on various systems to evaluate their performance. Results show that the three fastest presets for VVenC enable encoding HD video with 4 to 25 fps on high performance laptops (Apple M1 Max and Intel i9-12900H) and UHD video with 2 to 10 fps on workstations (Apple M1 Ultra and Intel Xeon Gold 6348). The VVdeC decoder enables live decoding of HD video on a tablet with octa-core ARM CPU as well as live decoding of UHD video on the afore mentioned laptops.