Quality-Aware Dynamic Resolution Adaptation Framework for Adaptive Video Streaming
Open Access
- 15 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 292-298
Abstract
Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. XPSNR is observed to correlate better with the subjective quality of VVC-coded bitstreams. Towards this realization, we predict the average XPSNR of VVC-coded bitstreams using spatiotemporal complexity features of the video and the target encoding configuration using an XGBoost-based model. Based on the predicted XPSNR scores, we introduce a Quality-Aware Dynamic Resolution Adaptation (QADRA) framework for adaptive video streaming applications, where we determine the convex-hull online. Furthermore, keeping the encoding and decoding times within an acceptable threshold is mandatory for smooth and energy-efficient streaming. Hence, QADRA determines the encoding resolution and quantization parameter (QP) for each target bitrate by maximizing XPSNR while constraining the maximum encoding and/ or decoding time below a threshold. QADRA implements a JND-based representation elimination algorithm to remove perceptually redundant representations from the bitrate ladder. QADRA is an open-source Python-based framework published under the GNU GPLv3 license. Github: https://github.com/PhoenixVideo/QADRA Online documentation: https://phoenixvideo.github.io/QADRA/Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Decoding Complexity-Aware Bitrate-Ladder Estimation for Adaptive VVC Streaming2024
- Energy-efficient Adaptive Video Streaming with Latency-Aware Dynamic Resolution Encoding2024
- All-Intra Rate Control Using Low Complexity Video Features for Versatile Video Coding2023
- JND-aware Two-pass Per-title Encoding Scheme for Adaptive Live StreamingIEEE Transactions on Circuits and Systems for Video Technology, 2023
- AdaPool: Exponential Adaptive Pooling for Information-Retaining DownsamplingIEEE Transactions on Image Processing, 2022
- Overview of the Versatile Video Coding (VVC) Standard and its ApplicationsIEEE Transactions on Circuits and Systems for Video Technology, 2021
- A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTPIEEE Communications Surveys & Tutorials, 2018
- Complexity-based consistent-quality encoding in the cloud2016
- Estimating the HEVC decoding energy using the decoder processing time2015
- Random ForestsMachine Learning, 2001