Real-Time Adaptation to Time-Varying Constraints for Medical Video Communications
- 12 July 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 22 (4) , 1177-1188
Abstract
The wider adoption of mobile Health video communication systems in standard clinical practice requires real-time control to provide for adequate levels of clinical video quality to support reliable diagnosis. The latter can only be achieved with real-time adaptation to time-varying wireless networks' state to guarantee clinically acceptable performance throughout the streaming session, while conforming to device capabilities for supporting real-time encoding. We propose an adaptive video encoding framework based on multi-objective optimization that jointly maximizes the encoded video's quality and encoding rate (in frames per second) while minimizing bitrate demands. For this purpose, we construct a dense encoding space and use linear regression to estimate forward prediction models for quality, bitrate, and computational complexity. The prediction models are then used in an adaptive control framework that can fine-tune video encoding based on real-time constraints. We validate the system using a leave-one-out algorithm applied to ten ultrasound videos of the common carotid artery. The prediction models can estimate structural similarity quality with a median accuracy error of less than 1%, bitrate demands with deviation error of 10% or less, and encoding frame rate within a 6% margin. Real-time adaptation at a group of pictures level is demonstrated using the high efficiency video coding standard. The effectiveness of the proposed framework compared to static, nonadaptive approaches is demonstrated for different modes of operation, achieving significant quality gains, bitrate demands reductions, and performance improvements, in real-life scenarios imposing time-varying constraints. Our approach is generic and should be applicable to other medical video modalities with different applications.Keywords
Funding Information
- National Science Foundation (NSF AWD CNS-1422031)
- University of Cyprus project “Dynamically Reconfigurable mHealth Video Communications for Real-time Adaptation to Time-Varying Constraints.”
This publication has 24 references indexed in Scilit:
- Adaptive emergency scenery video communications using HEVC for responsive decision support in disaster incidents2015
- Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding StandardIEEE Transactions on Circuits and Systems for Video Technology, 2015
- An Overview of mHealth Medical Video Communication Systems2015
- Modeling the energy consumption of HEVC P- and B-frame decoding2014
- Real-Time Echocardiogram Transmission Protocol Based on Regions and Visualization ModesIEEE Journal of Biomedical and Health Informatics, 2014
- A Study on Quality Assessment for Medical Ultrasound Video Compressed via HEVCIEEE Journal of Biomedical and Health Informatics, 2014
- SPIHT-Based Echocardiogram Compression: Clinical Evaluation and Recommendations of UseIEEE Journal of Biomedical and Health Informatics, 2013
- Flexible Macroblock Ordering for Context-Aware Ultrasound Video Transmission over Mobile WiMAXInternational Journal of Telemedicine and Applications, 2010
- Delivering Diagnostic Quality Video over Mobile Wireless Networks for TelemedicineInternational Journal of Telemedicine and Applications, 2009
- Texture-based classification of atherosclerotic carotid plaquesIEEE Transactions on Medical Imaging, 2003