Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Yifan Wang has a total of 19 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Camera Motion-Conditioned Motion Estimation for Neural Video Coding for Cloud Gaming

    by Yifan Wang, Fei Yang, Luka Murn, Juil Sock, Marc Gorriz Blanch, Shuai Wan, Wei Zhang, Fuzheng Yang, Luis Herranz

    The rising popularity of cloud gaming highlights the importance of effective video compression for this domain. Despite the potential of neural video codecs to surpass traditional codecs, their application to cloud gaming videos generally achieves limited performance primarily due to two reasons: (1) most advanced neural video codecs are designed for natural videos with only a few optimized for cloud gaming content, and (2) the distinctive characteristics of cloud gaming videos including abrupt and large camera movements, coupled with repetitive textures, make the direct application of existing codecs suboptimal. To this end, this paper introduces an enhanced neural video codec for cloud gaming with camera motion-conditioned motion estimation. By leveraging the unique feature of cloud gaming, we effectively utilize the camera motion information to condition motion estimation with an attention mechanism, overcoming the pronounced challenges of motion estimation and facilitating the accurate learning of optical flow. Furthermore, we optimize the loss function of the motion estimation network by employing a comprehensive loss across multiple feature levels, ensuring the learned optical flow is multi-faceted and well-suited to subsequent motion compensation. Extensive experiments demonstrate the effectiveness of the proposed codec, providing improved motion estimation capabilities and superior rate-distortion performance. Moreover, the robustness of our codec to rapid camera movements is validated, which makes it highly suitable for cloud gaming scenarios.

  • Open Access

    Enhanced neural video compression for cloud gaming videos with aligned frame generation

    by Yifan Wang, Fei Yang, Luka Murn, Juil Sock, Marc Gorriz Blanch, Shuai Wan, Wei Zhang, Fuzheng Yang, Luis Herranz


  • Fast H.266/VVC Intra Coding by Early Skipping Joint Coding of Chroma Residuals

    by Yifan Wang, Shixuan Feng, Wei Zhang, Kai Li, Fuzheng Yang

    Versatile Video Coding (H.266/VVC) significantly enhances compression performance but also increases encoding complexity. Numerous fast intra coding algorithms have been proposed to balance the performance gains with the increased complexity introduced by various advanced tools. However, few fast algorithms are specific to Joint Coding of Chroma Residuals (JCCR), a newly introduced technique that requires additional rate-distortion optimization (RDO) processes. To address this gap, this letter introduces a fast intra coding algorithm that reduces complexity by early skipping unnecessary JCCR. Specifically, we propose skipping JCCR when the correlation between chroma components is low, and we construct a JCCR normalized reconstruction distortion to measure this correlation. The skip conditions are determined by statistical analysis, intelligently reducing the number of RDO processes for chroma components. Experimental results show that, compared to the Fraunhofer Versatile Video Encoder (VVenC), our algorithm achieves encoding time savings of 1.68% and 2.82% under Random Access (RA) and All Intra (AI) settings, respectively, with a performance loss of 0.03% and 0.09% only, demonstrating the effectiveness of our fast algorithm.


  • VVC Intra Coding Complexity Optimization Based on Early Skipping of the Secondary Transform

    by Yifan Wang, Shixuan Feng, Wei Zhang, Fuzheng Yang

    The new generation video coding standard, H.266/-VVC, brings performance gains while significantly increasing coding complexity. Most of the complexity optimization methods for intra coding focus on reducing the number of prediction modes entering the rate-distortion optimization, but there are few concerning the newly introduced secondary transform. This letter extends the scope of existing studies and provides valuable insights for intra coding complexity optimization based on early skipping of the secondary transform. Specifically, considering the distribution of residuals assessed by coefficients after the primary transform, we propose to skip the secondary transform when the residual variation is relatively flat or the distortion caused by zeroing high-frequency coefficients is significant. Based on this analysis, we establish two skip conditions through statistical analysis and enable efficient decision-making by skipping the unnecessary secondary transform. Experimental results demonstrate the effectiveness of our algorithm, achieving 3.84% and 10.29% reductions in encoding time with only 0.39% and 1.03% increases in Bjontegaard delta bit-rate compared to Fraunhofer Versatile Video Encoder (VVenC)’s medium preset, under random-access (RA) and all-intra (AI) configurations respectively.


  • Open Access

    Cloud Gaming Video Coding Optimization Based on Camera Motion-Guided Reference Frame Enhancement

    by Yifan Wang, Hao Wang, Kaijie Wang, Wei Zhang

    Recent years have witnessed tremendous advances in clouding gaming. To alleviate the bandwidth pressure due to transmissions of high-quality cloud gaming videos, this paper optimized existing video codecs with deep learning networks to reduce the bitrate consumption of cloud gaming videos. Specifically, a camera motion-guided network, i.e., CMGNet, was proposed for the reference frame enhancement, leveraging the camera motion information of cloud gaming videos and the reconstructed frames in the reference frame list. The obtained high-quality reference frame was then added to the reference frame list to improve the compression efficiency. The decoder side performs the same operation to generate the reconstructed frames using the updated reference frame list. In the CMGNet, camera motions were used as guidance to estimate the frame motion and weight masks to achieve more accurate frame alignment and fusion, respectively. As a result, the quality of the reference frame was significantly enhanced and thus being more suitable as a prediction candidate for the target frame. Experimental results demonstrate the effectiveness of the proposed algorithm, which achieves 4.91% BD-rate reduction on average. Moreover, a cloud gaming video dataset with camera motion data was made available to promote research on game video compression.


  • Efficient self-adaptive access control for personal medical data in emergency setting

    by Yifan Wang, Yunling Wang, Jianfeng Wang

    The notion of access control allows data owners to outsource their data to cloud server, while encouraging the sharing of data with legally authorised users. Note that the traditional access control techniques only allow authorised users to access the sharing data. However, it is intractable to obtain the required data when the data owner encounters some emergency circumstances, such as, medical first-aid. Recently, Yang et al. proposed a self-adaptive access control scheme, which can ensure secure data sharing in both normal and emergency medical scenarios. However, their construction needs to involve an emergency contact person. We argue that Yang et al.'s scheme suffers from two weaknesses: 1) it is vulnerable to single point of failure when the emergency contact person is offline; 2) the two cloud model brings extra computation and communication overhead. To overcome the above shortcomings, we present a new efficient self-adaptive medical data access control by integrating fuzzy identity-based encryption and convergent encryption. Specifically, our proposed construction can achieve patients' data access by their fingerprint in emergency setting. Furthermore, the proposed scheme supports cross-user data deduplication and improves the performance of system by convergent encryption. Experiment results show that our scheme has an advantage in efficiency.