Jing Ye
Research Subjects
Research Interests
Jing Ye has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Zhiyong Zhang
School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen, China
3 shared publications Changzhen Qiu
2 shared publications- Han Gao
Tencent America, LLC (United States)
2 shared publications - Shan Liu
Sichuan Provincial Key Laboratory for Human Disease Gene Study, Department of Medical Genetics, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 610072, China
2 shared publications - Xin Zhao
Tencent America, LLC (United States)
2 shared publications - Ali Reza Kamali
Northeastern University
1 shared publication
Latest Publications
- 25 March 2024
- Published by Elsevier in Expert Systems with Applications
- Vol. 249
Joint low-light enhancement and deblurring with structural priors guidance
- 25 March 2024
- Published by Elsevier in Expert Systems with Applications
- Vol. 249
Joint low-light enhancement and deblurring with structural priors guidance
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 139-147
Advancements in intra prediction techniques beyond AV1 codec
Smooth prediction modes and angular intra prediction modes are two major types of intra prediction modes in AV1 video codec designed to reduce spatial redundancy in video signals. The smooth prediction mode is particularly effective in predicting blocks with a smooth gradient within the block, while angular intra prediction mode predicts pixel values by a weighted average of neighboring pixels along different angular directions within the block. This paper proposes extensions to these modes to improve the intra coding performance towards a next-generation video codec beyond the AV1 codec. The first extension involves refining the smooth modes by considering the geometric distance between each sample and its reference pixels to achieve more precise prediction. The second extension involves refining the distribution of intra prediction angles in AV1 such that the intra prediction angles are denser around vertical and horizontal modes and coarser around diagonal directions. The third extension proposes applying Intra Bi-Prediction (IBP) to a subset of prediction angles, which implicitly allows the codec to choose between IBP on and off case. Experimental results show that the proposed methods achieve up to 0.3% luma and chroma average BD-rate savings with no encoding time increase for all intra configuration when compared to research-v4.0.0 tag of reference software AVM which is developed for exploring next-generation video coding beyond AV1. Notably, the highest coding gain observed was up to 1.5% for 4K video sequences.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 139-147
Advancements in intra prediction techniques beyond AV1 codec
Smooth prediction modes and angular intra prediction modes are two major types of intra prediction modes in AV1 video codec designed to reduce spatial redundancy in video signals. The smooth prediction mode is particularly effective in predicting blocks with a smooth gradient within the block, while angular intra prediction mode predicts pixel values by a weighted average of neighboring pixels along different angular directions within the block. This paper proposes extensions to these modes to improve the intra coding performance towards a next-generation video codec beyond the AV1 codec. The first extension involves refining the smooth modes by considering the geometric distance between each sample and its reference pixels to achieve more precise prediction. The second extension involves refining the distribution of intra prediction angles in AV1 such that the intra prediction angles are denser around vertical and horizontal modes and coarser around diagonal directions. The third extension proposes applying Intra Bi-Prediction (IBP) to a subset of prediction angles, which implicitly allows the codec to choose between IBP on and off case. Experimental results show that the proposed methods achieve up to 0.3% luma and chroma average BD-rate savings with no encoding time increase for all intra configuration when compared to research-v4.0.0 tag of reference software AVM which is developed for exploring next-generation video coding beyond AV1. Notably, the highest coding gain observed was up to 1.5% for 4K video sequences.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 23-172
Wedge mode extensions beyond AV1 video codec
Wedge mode is a crucial compound prediction mode for predicting a block that includes motion object boundaries in the AV1 video codec. The current AV1 design incorporates 16 block shape adaptive modes, utilizing a set of handcrafted one-dimensional blending masks, which are predefined and applied to the blending process of combining two predictors. However, this design lacks flexibility to cater to various types of motion object boundaries in real-world scenarios. This paper proposes an extended wedge mode to replace the original design. The proposed method features novel components such as relaxed block sizes and number of modes limitation, mathematically derived non-linear based two-dimensional masks for the blending process, and more efficient mode signaling methods. The experimental results of the proposed method evaluated with the AOM reference software under the AOM common test conditions demonstrate that it provides an averaged YUV Bjøntegaard Delta rate reduction of 0.3 % for random access and 0.7 % for low delay configurations without a major increase in complexity.
- 4 October 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12674, 23-172
Wedge mode extensions beyond AV1 video codec
Wedge mode is a crucial compound prediction mode for predicting a block that includes motion object boundaries in the AV1 video codec. The current AV1 design incorporates 16 block shape adaptive modes, utilizing a set of handcrafted one-dimensional blending masks, which are predefined and applied to the blending process of combining two predictors. However, this design lacks flexibility to cater to various types of motion object boundaries in real-world scenarios. This paper proposes an extended wedge mode to replace the original design. The proposed method features novel components such as relaxed block sizes and number of modes limitation, mathematically derived non-linear based two-dimensional masks for the blending process, and more efficient mode signaling methods. The experimental results of the proposed method evaluated with the AOM reference software under the AOM common test conditions demonstrate that it provides an averaged YUV Bjøntegaard Delta rate reduction of 0.3 % for random access and 0.7 % for low delay configurations without a major increase in complexity.
- 27 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (3) , 1873-1885
SNR-Prior Guided Trajectory-Aware Transformer for Low-Light Video Enhancement
Recently, deep learning has been widely employed to improve the quality of low-light videos. However, most existing low-light video enhancement methods fail to effectively explore temporal dependence, and the enhanced videos may suffer from severe noise, loss of detailed texture, and temporal inconsistency. In this paper, we propose a novel SNR-prior Guided Trajectory-aware Transformer (SGTT) to enable effective video representation learning for low-light video enhancement. Specifically, signal-to-noise ratio prior and cosine similarity are introduced to build the trajectory-aware dual-attention for exploiting the dependence of long-range spatio-temporal information, which searches for sharper and highly correlated patches within the same trajectory to assist in enhancing the target frames. Moreover, to adaptively fuse spatio-temporal information of support frames propagated bidirectionally, an attention-guided spatio-temporal feature aggregation module is proposed to perceive and enhance the specific high-quality features. The evaluation of both dynamic and static videos shows the effectiveness of our network, which significantly outperforms the state-of-the-art methods.
- 27 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (3) , 1873-1885
SNR-Prior Guided Trajectory-Aware Transformer for Low-Light Video Enhancement
Recently, deep learning has been widely employed to improve the quality of low-light videos. However, most existing low-light video enhancement methods fail to effectively explore temporal dependence, and the enhanced videos may suffer from severe noise, loss of detailed texture, and temporal inconsistency. In this paper, we propose a novel SNR-prior Guided Trajectory-aware Transformer (SGTT) to enable effective video representation learning for low-light video enhancement. Specifically, signal-to-noise ratio prior and cosine similarity are introduced to build the trajectory-aware dual-attention for exploiting the dependence of long-range spatio-temporal information, which searches for sharper and highly correlated patches within the same trajectory to assist in enhancing the target frames. Moreover, to adaptively fuse spatio-temporal information of support frames propagated bidirectionally, an attention-guided spatio-temporal feature aggregation module is proposed to perceive and enhance the specific high-quality features. The evaluation of both dynamic and static videos shows the effectiveness of our network, which significantly outperforms the state-of-the-art methods.
- Open Access
Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction.
Open AccessLow-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction.
- 1 October 2021
- Published by Elsevier in Minerals Engineering
- Vol. 172, 107175
Reactive molten salt modification of ilmenite as a green approach for the preparation of inexpensive Li ion battery anode materials
- 1 October 2021
- Published by Elsevier in Minerals Engineering
- Vol. 172, 107175
Reactive molten salt modification of ilmenite as a green approach for the preparation of inexpensive Li ion battery anode materials
- 1 September 2021
- Published by British Institute of Non-Destructive Testing (BINDT) in Insight - Non-Destructive Testing and Condition Monitoring
- Vol. 63 (9) , 547-553
Weld defect inspection based on machine vision and weak magnetic technology
This study proposes a weld defect inspection method based on a combination of machine vision and weak magnetic technology to inspect the quality of weld formation comprehensively. In accordance with the principle of laser triangulation, surface information about the weldment is obtained, the weld area is extracted using mutation characteristics of the weld edge and an algorithm for identifying defects with abnormal average height in the weld surface is proposed. Subsequently, a welding seam inspection process is developed and implemented, which is composed of a camera, a structured light sensor, a magnetic sensor and a motion control system. Inspection results from an austenitic stainless steel weldment show that the method combining machine vision and magnetism can identify defect locations accurately. Comprehensive analysis of the test results can effectively classify surface and internal defects, estimate the equivalent sizes of defects and evaluate the quality of weld formation in multiple dimensions.
- 1 September 2021
- Published by British Institute of Non-Destructive Testing (BINDT) in Insight - Non-Destructive Testing and Condition Monitoring
- Vol. 63 (9) , 547-553
Weld defect inspection based on machine vision and weak magnetic technology
This study proposes a weld defect inspection method based on a combination of machine vision and weak magnetic technology to inspect the quality of weld formation comprehensively. In accordance with the principle of laser triangulation, surface information about the weldment is obtained, the weld area is extracted using mutation characteristics of the weld edge and an algorithm for identifying defects with abnormal average height in the weld surface is proposed. Subsequently, a welding seam inspection process is developed and implemented, which is composed of a camera, a structured light sensor, a magnetic sensor and a motion control system. Inspection results from an austenitic stainless steel weldment show that the method combining machine vision and magnetism can identify defect locations accurately. Comprehensive analysis of the test results can effectively classify surface and internal defects, estimate the equivalent sizes of defects and evaluate the quality of weld formation in multiple dimensions.
- 7 October 2018
- Published by Springer Nature
- p. 541-557
Dimensional Variation Simulation Analysis of Front Wheel Camber for Macpherson Suspension
- 7 October 2018
- Published by Springer Nature
- p. 541-557
Dimensional Variation Simulation Analysis of Front Wheel Camber for Macpherson Suspension