Yao Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Yao Wang has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Cagdas Bilen1 shared publication
- Elza Erkip
Department of Electrical and Computer Engineering, New York University, Brooklyn, NY, USA
1 shared publication - Hang Liu
Corporate Research Lab, Thomson Inc., 2 Independence Way, Princeton, NJ 08540
1 shared publication Hao Hu
1 shared publication- Hua Yang
Corporate Research, Thomson Inc., Princeton, NJ 08540, USA
1 shared publication Huiqi Zeng
1 shared publication
Latest Publications
- Open Access
Perceptual Quality of Video with Periodic Frame Rate and Quantization Variation-Subjective Studies and Analytical Modeling
In networked video applications, the frame rate (FR) and quantization stepsize (QS) of a compressed video are often adapted in response to the changes of the available bandwidth. It is important to understand how do the variation of FR and QS and their variation pattern affect the video quality. In this paper, we investigate the impact of temporal variation of FR and QS on the perceptual video quality. Among all possible variation patterns, we focus on videos in which two FR's (or QS's) alternate over a fixed interval. We explore the human responses to such variation by conducting subjective evaluation of test videos with different variation magnitudes and frequencies. We further analyze statistical significance of the impact of variation magnitude, variation frequency, video content, and their interactions. By analyzing the subjective ratings, we propose two models for predicting the quality of video with alternating FR and QS, respectively, The proposed models have simple mathematical forms with a few content-dependent parameters. The models fit the measured data very well using parameters determined by least square fitting with the measured data. We further propose some guidelines for adaptation of FR and QS based on trends observed from subjective test results.
Open AccessPerceptual Quality of Video with Periodic Frame Rate and Quantization Variation-Subjective Studies and Analytical Modeling
In networked video applications, the frame rate (FR) and quantization stepsize (QS) of a compressed video are often adapted in response to the changes of the available bandwidth. It is important to understand how do the variation of FR and QS and their variation pattern affect the video quality. In this paper, we investigate the impact of temporal variation of FR and QS on the perceptual video quality. Among all possible variation patterns, we focus on videos in which two FR's (or QS's) alternate over a fixed interval. We explore the human responses to such variation by conducting subjective evaluation of test videos with different variation magnitudes and frequencies. We further analyze statistical significance of the impact of variation magnitude, variation frequency, video content, and their interactions. By analyzing the subjective ratings, we propose two models for predicting the quality of video with alternating FR and QS, respectively, The proposed models have simple mathematical forms with a few content-dependent parameters. The models fit the measured data very well using parameters determined by least square fitting with the measured data. We further propose some guidelines for adaptation of FR and QS based on trends observed from subjective test results.
- Open Access
Rate Model for Compressed Video Considering Impacts Of Spatial, Temporal and Amplitude Resolutions and Its Applications for Video Coding and Adaptation
In this paper, we investigate the impacts of spatial, temporal and amplitude resolution (STAR) on the bit rate of a compressed video. We propose an analytical rate model in terms of the quantization stepsize, frame size and frame rate. Experimental results reveal that the increase of the video rate as the individual resolution increases follows a power function. Hence, the proposed model expresses the rate as the product of power functions of the quantization stepsize, frame size and frame rate, respectively. The proposed rate model is analytically tractable, requiring only four content dependent parameters. We also propose methods for predicting the model parameters from content features that can be computed from original video. Simulation results show that model predicted rates fit the measured data very well with high Pearson correlation (PC) and small relative root mean square error (RRMSE). The same model function works for different coding scenarios (including scalable and non-scalable video, temporal prediction using either hierarchical B or IPPP structure, etc.) with very high accuracy (average PC $>$ 0.99), but the values of model parameters differ. Using the proposed rate model and the quality model introduced in a separate work, we show how to optimize the STAR for a given rate constraint, which is important for both encoder rate control and scalable video adaptation. Furthermore, we demonstrate how to order the spatial, temporal and amplitude layers of a scalable video in a rate-quality optimized way.Open AccessRate Model for Compressed Video Considering Impacts Of Spatial, Temporal and Amplitude Resolutions and Its Applications for Video Coding and Adaptation
In this paper, we investigate the impacts of spatial, temporal and amplitude resolution (STAR) on the bit rate of a compressed video. We propose an analytical rate model in terms of the quantization stepsize, frame size and frame rate. Experimental results reveal that the increase of the video rate as the individual resolution increases follows a power function. Hence, the proposed model expresses the rate as the product of power functions of the quantization stepsize, frame size and frame rate, respectively. The proposed rate model is analytically tractable, requiring only four content dependent parameters. We also propose methods for predicting the model parameters from content features that can be computed from original video. Simulation results show that model predicted rates fit the measured data very well with high Pearson correlation (PC) and small relative root mean square error (RRMSE). The same model function works for different coding scenarios (including scalable and non-scalable video, temporal prediction using either hierarchical B or IPPP structure, etc.) with very high accuracy (average PC $>$ 0.99), but the values of model parameters differ. Using the proposed rate model and the quality model introduced in a separate work, we show how to optimize the STAR for a given rate constraint, which is important for both encoder rate control and scalable video adaptation. Furthermore, we demonstrate how to order the spatial, temporal and amplitude layers of a scalable video in a rate-quality optimized way. - Open Access
Compressed Sensing for Moving Imagery in Medical Imaging
Numerous applications in signal processing have benefited from the theory of compressed sensing which shows that it is possible to reconstruct signals sampled below the Nyquist rate when certain conditions are satisfied. One of these conditions is that there exists a known transform that represents the signal with a sufficiently small number of non-zero coefficients. However when the signal to be reconstructed is composed of moving images or volumes, it is challenging to form such regularization constraints with traditional transforms such as wavelets. In this paper, we present a motion compensating prior for such signals that is derived directly from the optical flow constraint and can utilize the motion information during compressed sensing reconstruction. Proposed regularization method can be used in a wide variety of applications involving compressed sensing and images or volumes of moving and deforming objects. It is also shown that it is possible to estimate the signal and the motion jointly or separately. Practical examples from magnetic resonance imaging has been presented to demonstrate the benefit of the proposed method.
Open AccessCompressed Sensing for Moving Imagery in Medical Imaging
Numerous applications in signal processing have benefited from the theory of compressed sensing which shows that it is possible to reconstruct signals sampled below the Nyquist rate when certain conditions are satisfied. One of these conditions is that there exists a known transform that represents the signal with a sufficiently small number of non-zero coefficients. However when the signal to be reconstructed is composed of moving images or volumes, it is challenging to form such regularization constraints with traditional transforms such as wavelets. In this paper, we present a motion compensating prior for such signals that is derived directly from the optical flow constraint and can utilize the motion information during compressed sensing reconstruction. Proposed regularization method can be used in a wide variety of applications involving compressed sensing and images or volumes of moving and deforming objects. It is also shown that it is possible to estimate the signal and the motion jointly or separately. Practical examples from magnetic resonance imaging has been presented to demonstrate the benefit of the proposed method.
- 10 March 2009
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 3 (2) , 280-293
A Novel Video Quality Metric for Low Bit-Rate Video Considering Both Coding and Packet-Loss Artifacts
This paper investigates the perceptual quality of video affected by packet losses. We focus on low-resolution and low bit-rate video coded by the H.264/AVC encoder and the packet loss patterns likely in low bit-rate wireless networks. We examine the impact of several factors on the perceptual quality, including the error length (the error propagation duration after a loss), the loss severity (measured by the pixel difference between reference and distorted video in the area affected by a loss), loss location, the number of losses, and loss patterns. Based on our findings, we propose an objective metric for the quality degradation due to packet losses that considers all these factors. We also validate a prior metric relating the quality degradation due to compression artifacts and the peak-signal-to-noise ratio (PSNR). We finally propose a full-reference metric that measures the overall quality degradation due to both packet losses and lossy compression. The proposed metric correlates very well with subjective ratings, for a large set of video clips with different loss patterns, coding artifacts, and scene contents.
- 10 March 2009
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 3 (2) , 280-293
A Novel Video Quality Metric for Low Bit-Rate Video Considering Both Coding and Packet-Loss Artifacts
This paper investigates the perceptual quality of video affected by packet losses. We focus on low-resolution and low bit-rate video coded by the H.264/AVC encoder and the packet loss patterns likely in low bit-rate wireless networks. We examine the impact of several factors on the perceptual quality, including the error length (the error propagation duration after a loss), the loss severity (measured by the pixel difference between reference and distorted video in the area affected by a loss), loss location, the number of losses, and loss patterns. Based on our findings, we propose an objective metric for the quality degradation due to packet losses that considers all these factors. We also validate a prior metric relating the quality degradation due to compression artifacts and the peak-signal-to-noise ratio (PSNR). We finally propose a full-reference metric that measures the overall quality degradation due to both packet losses and lossy compression. The proposed metric correlates very well with subjective ratings, for a large set of video clips with different loss patterns, coding artifacts, and scene contents.
- 1 November 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Asilomar Conference on Signals, Systems & Computers
- No. 10586393,p. 819-823
Cooperative Transmission of Correlated Gaussian Sources
Cooperation of wireless users is known to provide substantial improvements in channel reliability and in end-to- end distortion when nodes have access to independent sources. In this paper we investigate the effect of cooperation and distributed compression when the sources are correlated. For distributed compression, realizing that each compressed stream may not reach the destination due to fading, we first derive the achievable rate-distortion pairs for Gaussian sources to have robust descriptions. Then we show how user cooperation can be coupled with robust distributed compression to further improve the end-to-end distortion for correlated sources.
- 1 November 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Asilomar Conference on Signals, Systems & Computers
- No. 10586393,p. 819-823
Cooperative Transmission of Correlated Gaussian Sources
Cooperation of wireless users is known to provide substantial improvements in channel reliability and in end-to- end distortion when nodes have access to independent sources. In this paper we investigate the effect of cooperation and distributed compression when the sources are correlated. For distributed compression, realizing that each compressed stream may not reach the destination due to fading, we first derive the achievable rate-distortion pairs for Gaussian sources to have robust descriptions. Then we show how user cooperation can be coupled with robust distributed compression to further improve the end-to-end distortion for correlated sources.
- 1 July 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 48-51
P2P Video Live Streaming with MDC: Providing Incentives for Redistribution
In this paper, we consider applying multiple description coding in mesh-pull P2P live streaming networks to provide incentives for redistribution. In our system, a video is encoded into multiple descriptions with each description having equal importance. We consider a heterogeneous system with peers having different uplink bandwidths. We design a distributed protocol in which a peer contributing more uplink bandwidth receives more descriptions and consequently better video quality. Previous approaches consider single-layer video, where each peer receives the same video quality no matter how much bandwidth it contributes to the system. The simulation results show that our approach can provide differentiated video quality commensurate with a peer's contribution to other peers.
- 1 July 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 48-51
P2P Video Live Streaming with MDC: Providing Incentives for Redistribution
In this paper, we consider applying multiple description coding in mesh-pull P2P live streaming networks to provide incentives for redistribution. In our system, a video is encoded into multiple descriptions with each description having equal importance. We consider a heterogeneous system with peers having different uplink bandwidths. We design a distributed protocol in which a peer contributing more uplink bandwidth receives more descriptions and consequently better video quality. Previous approaches consider single-layer video, where each peer receives the same video quality no matter how much bandwidth it contributes to the system. The simulation results show that our approach can provide differentiated video quality commensurate with a peer's contribution to other peers.
- 1 May 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02714302,p. 297-300
Image Compression using 2D Dual-tree Discrete Wavelet Transform (DDWT)
In this paper, we investigate image compression using 2D dual-tree discrete wavelet transform (DDWT), which is an overcomplete transform with direction-selective basis functions. To further sparsify DDWT coefficients, an iterative projection-based noise shaping method is employed. We analyze the statistics of DDWT coefficients as well as the inter-scale, inter-subband, and intra-subband dependency among the DDWT coefficients. We further evaluate the application of SPIHT and EBCOT for coding DDWT coefficients. Experimental results show that SPIHT is more effective than EBCOT for DDWT, and the DDWT-SPIHT coder outperforms JPEG2000 at low bit rates and is comparable to JPEG2000 at high bit rates.
- 1 May 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02714302,p. 297-300
Image Compression using 2D Dual-tree Discrete Wavelet Transform (DDWT)
In this paper, we investigate image compression using 2D dual-tree discrete wavelet transform (DDWT), which is an overcomplete transform with direction-selective basis functions. To further sparsify DDWT coefficients, an iterative projection-based noise shaping method is employed. We analyze the statistics of DDWT coefficients as well as the inter-scale, inter-subband, and intra-subband dependency among the DDWT coefficients. We further evaluate the application of SPIHT and EBCOT for coding DDWT coefficients. Experimental results show that SPIHT is more effective than EBCOT for DDWT, and the DDWT-SPIHT coder outperforms JPEG2000 at low bit rates and is comparable to JPEG2000 at high bit rates.
- 1 May 2006
- Published by Zhejiang University Press in Journal of Zhejiang University-SCIENCE A
- Vol. 7 (5) , 837-846
An adaptive joint source and channel coding scheme for H.264 video multicasting over wireless LAN
This paper proposes an adaptive joint source and channel coding scheme for H.264 video multicast over wireless LAN which takes into account the user topology changes and varying channel conditions of multiple users, and dynamically allocates available bandwidth between source coding and channel coding, with the goal to optimize the overall system performance. In particular, source resilience and error correction are considered jointly in the scheme to achieve the optimal performance. And a channel estimation algorithm based on the average packet loss rate and the variance of packet loss rate is proposed also. Two overall performance criteria for video multicast are investigated and experimental results are presented to show the improvement obtained by the scheme.
- 1 May 2006
- Published by Zhejiang University Press in Journal of Zhejiang University-SCIENCE A
- Vol. 7 (5) , 837-846
An adaptive joint source and channel coding scheme for H.264 video multicasting over wireless LAN
This paper proposes an adaptive joint source and channel coding scheme for H.264 video multicast over wireless LAN which takes into account the user topology changes and varying channel conditions of multiple users, and dynamically allocates available bandwidth between source coding and channel coding, with the goal to optimize the overall system performance. In particular, source resilience and error correction are considered jointly in the scheme to achieve the optimal performance. And a channel estimation algorithm based on the average packet loss rate and the variance of packet loss rate is proposed also. Two overall performance criteria for video multicast are investigated and experimental results are presented to show the improvement obtained by the scheme.