Audio–Visual Emotion-Aware Cloud Gaming Framework
- 12 June 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 25 (12) , 2105-2118
Abstract
The promising potential and emerging applications of cloud gaming have drawn increasing interest from academia, industry, and the general public. However, providing a high-quality gaming experience in the cloud gaming framework is a challenging task because of the tradeoff between resource consumption and player emotion, which is affected by the game screen. We tackle this problem by leveraging emotion-aware screen effects in the cloud gaming framework and combining them with remote display technology. The first stage in the framework is the learning or training stage, which establishes a relationship between screen features and emotions using Gaussian mixture model-based classifiers. In the operating stage, a linear programming model provides appropriate screen changes based on the real-time user emotion obtained in the first stage. Our experiments demonstrate the effectiveness of the proposed framework. The results show that our proposed framework can provide a high quality gaming experience while generating an acceptable amount of workload for the cloud server in terms of resource consumption.Keywords
Funding Information
- Deanship of Scientific Research through King Saud University, Riyadh, Saudi Arabia, within the Research Group Project (RGP-1436-023)
This publication has 26 references indexed in Scilit:
- EMC: Emotion-aware mobile cloud computing in 5GIEEE Network, 2015
- On the Quality of Service of Cloud Gaming SystemsIEEE Transactions on Multimedia, 2013
- Human emotion recognition from videos using spatio-temporal and audio featuresThe Visual Computer, 2012
- Environment Recognition for Digital Audio Forensics Using MPEG-7 and MEL Cepstral FeaturesJournal of Electrical Engineering, 2011
- Audio Visual Emotion Recognition Based on Triple-Stream Dynamic Bayesian Network Models2011
- Speech Emotion Recognition Using Both Spectral and Prosodic Features2009
- Latency and player actions in online gamesCommunications of the ACM, 2006
- Face Description with Local Binary Patterns: Application to Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Behavior Recognition via Sparse Spatio-Temporal Features2006
- Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture2004