Bingkun Chen

Previous deblurring methods mostly tackle global motion blur due to camera shake but struggle with local motion blur from object movement, facing challenges like the random motion blur locations, data imbalance, directional ambiguity, and positional uncertainty. To fill the vacancy of real-world local motion deblurring, we establish ReLoBlur, the first real-world local motion deblurring dataset. ReLoBlur is captured by a synchronized beam-splitting photographing system and annotated via our developed Local Blur Foreground Mask Generator (LBFMG). To bridge the gap between local and global motion deblurring, we propose a Local Blur-Aware Gated network (LBAG) with gate blocks to focus deblurring on blurred regions, and a Blur-Aware Patch Cropping Strategy (BAPC) to address the data imbalance problem. Acknowledging directional ambiguity and positional uncertainty from shooting errors and non-uniform object motion, we enhance LBAG with LBAGp, guided by center-related distance, and optimized by a symmetric minimization loss. Extensive experiments prove the reliability of the ReLoBlur dataset, and demonstrate that LBAG and LBAGp achieve better local motion deblurring performance compared to state-of-the-art (SOTA) CNN-based deblurring methods.

Recently, the joint design of optical systems and downstream algorithms is showing significant potential. However, existing rays-described methods are limited to optimizing geometric degradation, making it difficult to fully represent the optical characteristics of complex, miniaturized lenses constrained by wavefront aberration or diffraction effects. In this work, we introduce a precise optical simulation model, and every operation in pipeline is differentiable. This model employs a novel initial value strategy to enhance the reliability of intersection calculation on high aspherics. Moreover, it utilizes a differential operator to reduce memory consumption during coherent point spread function calculations. To efficiently address various degradation, we design a joint optimization procedure that leverages field information. Guided by a general restoration network, the proposed method not only enhances the image quality, but also successively improves the optical performance across multiple lenses that are already in professional level. This joint optimization pipeline offers innovative insights into the practical design of sophisticated optical systems and post-processing algorithms. The source code will be made publicly available at https://github.com/Zrr-ZJU/Successive-optimization