JYJing Ye

Jing Ye

*This is an algorithmically generated author record based on publicly available information.

Jing Ye has a total of 17 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Advancements in intra prediction techniques beyond AV1 codec

    by Jing Ye, Liang Zhao, Xin Zhao, Han Gao, Shan Liu

    Smooth prediction modes and angular intra prediction modes are two major types of intra prediction modes in AV1 video codec designed to reduce spatial redundancy in video signals. The smooth prediction mode is particularly effective in predicting blocks with a smooth gradient within the block, while angular intra prediction mode predicts pixel values by a weighted average of neighboring pixels along different angular directions within the block. This paper proposes extensions to these modes to improve the intra coding performance towards a next-generation video codec beyond the AV1 codec. The first extension involves refining the smooth modes by considering the geometric distance between each sample and its reference pixels to achieve more precise prediction. The second extension involves refining the distribution of intra prediction angles in AV1 such that the intra prediction angles are denser around vertical and horizontal modes and coarser around diagonal directions. The third extension proposes applying Intra Bi-Prediction (IBP) to a subset of prediction angles, which implicitly allows the codec to choose between IBP on and off case. Experimental results show that the proposed methods achieve up to 0.3% luma and chroma average BD-rate savings with no encoding time increase for all intra configuration when compared to research-v4.0.0 tag of reference software AVM which is developed for exploring next-generation video coding beyond AV1. Notably, the highest coding gain observed was up to 1.5% for 4K video sequences.

  • Wedge mode extensions beyond AV1 video codec

    by Han Gao, Xin Zhao, Liang Zhao, Jing Ye, Shan Liu

    Wedge mode is a crucial compound prediction mode for predicting a block that includes motion object boundaries in the AV1 video codec. The current AV1 design incorporates 16 block shape adaptive modes, utilizing a set of handcrafted one-dimensional blending masks, which are predefined and applied to the blending process of combining two predictors. However, this design lacks flexibility to cater to various types of motion object boundaries in real-world scenarios. This paper proposes an extended wedge mode to replace the original design. The proposed method features novel components such as relaxed block sizes and number of modes limitation, mathematically derived non-linear based two-dimensional masks for the blending process, and more efficient mode signaling methods. The experimental results of the proposed method evaluated with the AOM reference software under the AOM common test conditions demonstrate that it provides an averaged YUV Bjøntegaard Delta rate reduction of 0.3 % for random access and 0.7 % for low delay configurations without a major increase in complexity.


  • SNR-Prior Guided Trajectory-Aware Transformer for Low-Light Video Enhancement

    by Jing Ye, Changzhen Qiu, Zhiyong Zhang

    Recently, deep learning has been widely employed to improve the quality of low-light videos. However, most existing low-light video enhancement methods fail to effectively explore temporal dependence, and the enhanced videos may suffer from severe noise, loss of detailed texture, and temporal inconsistency. In this paper, we propose a novel SNR-prior Guided Trajectory-aware Transformer (SGTT) to enable effective video representation learning for low-light video enhancement. Specifically, signal-to-noise ratio prior and cosine similarity are introduced to build the trajectory-aware dual-attention for exploiting the dependence of long-range spatio-temporal information, which searches for sharper and highly correlated patches within the same trajectory to assist in enhancing the target frames. Moreover, to adaptively fuse spatio-temporal information of support frames propagated bidirectionally, an attention-guided spatio-temporal feature aggregation module is proposed to perceive and enhance the specific high-quality features. The evaluation of both dynamic and static videos shows the effectiveness of our network, which significantly outperforms the state-of-the-art methods.


  • Open Access

    Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network

    by Jing Ye, Xintao Chen, Changzhen Qiu, Zhiyong Zhang

    Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction.


  • Weld defect inspection based on machine vision and weak magnetic technology

    by Jing Ye, Guisuo Xia, Fang Liu, Ping Fu, Qiangqiang Cheng

    This study proposes a weld defect inspection method based on a combination of machine vision and weak magnetic technology to inspect the quality of weld formation comprehensively. In accordance with the principle of laser triangulation, surface information about the weldment is obtained, the weld area is extracted using mutation characteristics of the weld edge and an algorithm for identifying defects with abnormal average height in the weld surface is proposed. Subsequently, a welding seam inspection process is developed and implemented, which is composed of a camera, a structured light sensor, a magnetic sensor and a motion control system. Inspection results from an austenitic stainless steel weldment show that the method combining machine vision and magnetism can identify defect locations accurately. Comprehensive analysis of the test results can effectively classify surface and internal defects, estimate the equivalent sizes of defects and evaluate the quality of weld formation in multiple dimensions.