Affective Content-aware Adaptation Scheme on QoE Optimization of Adaptive Streaming over HTTP
Authors:
Open Access
- 30 November 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 15 (3s) , 1-18
Abstract
The article presents a novel affective content-aware adaptation scheme (ACAA) to optimize Quality of Experience (QoE) for dynamic adaptive video streaming over HTTP (DASH). Most of the existing DASH adaptation schemes conduct video bit-rate adaptation based on an estimation of available network resources, which ignore user preference on affective content (AC) embedded in video data streaming over the network. Since the personal demands to AC is very different among all viewers, to satisfy individual affective demand is critical to improve the QoE in commercial video services. However, the results of video affective analysis cannot be applied into a current adaptive streaming scheme directly. Correlating the AC distributions in user's viewing history to each being streamed segment, the affective relevancy can be inferred as an affective metric for the AC related segment. Further, we have proposed an ACAA scheme to optimize QoE for user desired affective content while taking into account both network status and affective relevancy. We have implemented the ACAA scheme over a realistic trace-based evaluation and compared its performance in terms of network performance, QoE with that of Probe and Adaptation (PANDA), buffer-based adaptation (BBA), and Model Predictive Control (MPC). Experimental results show that ACAA can preserve available buffer time for future being delivered affective content preferred by viewer's individual preference to achieve better QoE in affective contents than those normal contents while remain the overall QoE to be satisfactory.Keywords
Funding Information
- Educational Commission Planning Project of Hubei (2018CFB721)
- National Natural Science Foundation of China (61672390, 61572012)
- National Key Research and Development Program of China (2017YFB1002600)
- Natural Science Foundation of Hubei (2018CFB721)
- Wuhan Science and Technology Plan (2017010201010109)
- Key Technological Innovation Projects of Hubei (2018AAA062)
- China Scholarship Council (201808420077)
- Humanities and Social Science project of Ministry of Education (18YJCZH050)
This publication has 30 references indexed in Scilit:
- Perceptual Quality of HTTP Adaptive Streaming Strategies: Cross-Experimental Analysis of Multi-Laboratory and Crowdsourced Subjective StudiesIEEE Journal on Selected Areas in Communications, 2016
- A Quality-of-Content-Based Joint Source and Channel Coding for Human Detections in a Mobile Surveillance CloudIEEE Transactions on Circuits and Systems for Video Technology, 2016
- A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTPACM SIGCOMM Computer Communication Review, 2015
- Video Affective Content Analysis: A Survey of State-of-the-Art MethodsIEEE Transactions on Affective Computing, 2015
- Content-aware adaptation scheme for QoE optimized dash applications2014
- A Survey on Quality of Experience of HTTP Adaptive StreamingIEEE Communications Surveys & Tutorials, 2014
- A buffer-based approach to rate adaptationACM SIGCOMM Computer Communication Review, 2014
- Commute path bandwidth traces from 3G networks2013
- Compact Video Synopsis via Global Spatiotemporal OptimizationIEEE Transactions on Visualization and Computer Graphics, 2012
- A three-level framework for affective content analysis and its case studiesMultimedia Tools and Applications, 2012