LMLingjuan Miao

Lingjuan Miao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Lingjuan Miao has a total of 60 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Infrared and Visible Image Fusion With Language-Driven Loss and Knowledge Distillation

    by Yuhao Wang, Lingjuan Miao, Zhiqiang Zhou, Lei Zhang, Yajun Qiao

    Infrared and visible image fusion (IVIF) has attracted much attention owing to the highly complementary properties of the two image modalities. Due to the lack of ground-truth fused images, the fusion output of current deep-learning-based methods heavily depends on the loss functions defined mathematically. As it is hard to well mathematically define the fused image without ground truth, the performance of existing fusion methods is limited. In this article, we first propose to use natural language to express the objective of IVIF, which can avoid the explicit mathematical modeling of fusion output in current losses, and make full use of the advantage of language expression to improve the fusion performance. For this purpose, we present a comprehensive language-expressed fusion objective and encode relevant texts into the multimodal embedding space using CLIP. A language-driven fusion model is then constructed in the embedding space by establishing the relationship among the embedded vectors representing the fusion objective and input image modalities. Finally, a language-driven loss is derived to make the actual IVIF aligned with the embedded language-driven fusion model via supervised training. In addition, to ensure that the loss works well with high robustness and generalization in practice, we introduce a novel regularization and patch filtering approach in the training. For real-time applications, we further propose a novel knowledge distillation framework, in which the student conducts self-learning under the supervision of the teacher that has been trained with the language-driven loss. This enables the student to maintain comparable performance and, more importantly, achieve real-time inference even on high-resolution images. Experiments show that our method can obtain much better fusion results than existing techniques. The code is available at https://github.com/wyhlaowang/LDFusion.


  • Open Access

    Infrared and Visible Image Fusion with Language-Driven Loss in CLIP Embedding Space

    by Yuhao Wang, Lingjuan Miao, Zhiqiang Zhou, Lei Zhang, Qiao Yajun


  • Open Access

    Faster and Better: Reinforced Collaborative Distillation and Self-Learning for Infrared-Visible Image Fusion

    by Yuhao Wang, Lingjuan Miao, Zhiqiang Zhou, Yajun Qiao, Lei Zhang

    Infrared and visible image fusion plays a critical role in enhancing scene perception by combining complementary information from different modalities. Despite recent advances, achieving high-quality image fusion with lightweight models remains a significant challenge. To bridge this gap, we propose a novel collaborative distillation and self-learning framework for image fusion driven by reinforcement learning. Unlike conventional distillation, this approach not only enables the student model to absorb image fusion knowledge from the teacher model, but more importantly, allows the student to perform self-learning on more challenging samples to enhance its capabilities. Particularly, in our framework, a reinforcement learning agent explores and identifies a more suitable training strategy for the student. The agent takes both the student's performance and the teacher-student gap as inputs, which leads to the generation of challenging samples to facilitate the student's self-learning. Simultaneously, it dynamically adjusts the teacher's guidance strength based on the student's state to optimize the knowledge transfer. Experimental results demonstrate that our method can significantly improve student performance and achieve better fusion results compared to existing techniques.

  • Unified Five-Distance Bounding Box Representation for Remote Sensing Oriented Object Detection

    by Yajun Qiao, Lingjuan Miao, Zhiqiang Zhou, Qi Ming, Yuhao Wang

    Currently, due to the densely packed and varied orientations of objects in the remote sensing images, the oriented object detection is still a challenging task. In the existing methods, the oriented bounding box (OBB) representations either include angle parameters or require a larger number of parameters and additional processes to obtain the final rotated rectangles, which can potentially induce the positional errors and decrease the accuracy of object detection in remote sensing images. In this paper, we propose a unified five-distance bounding box representation for remote sensing oriented object detection, which gets rid of the utilization of angle parameters and simultaneously represents the OBBs with the least distance-based parameters. We then construct a unified five-distance region proposal network (UF-RPN) based on the new OBB representation to achieve higher performance of oriented object detection. Additionally, most existing two-stage methods assume that the localization errors of objects are relatively small in the second stage of the network and believe that directly regressing the errors of general OBB representation would achieve sufficiently-high performance of object detection, neglecting that there is still room for improvement in the detection head by utilizing a more advanced OBB representation. Therefore, a five-distance detection head (FD-Head) is developed by utilizing the five-distance OBB representation in the detection head. Experimental results on the HRSC2016, DIOR-R, DOTA-v1.0 and DOTA-v2.0 datasets demonstrate the superiority and robustness of our method. Our code is publicly available at https://github.com/QYJ123/UFDet.


  • Open Access

    FLsM: Fuzzy Localization of Image Scenes Based on Large Models

    by Weiyi Chen, Lingjuan Miao, Jinchao Gui, Yuhao Wang, Yiran Li

    This article primarily focuses on the study of image-based localization technology. While traditional methods have made significant advancements in technology and applications, the emerging field of visual image-based localization technology demonstrates tremendous potential for research. Deep learning has exhibited a strong performance in image processing, particularly in developing visual navigation and localization techniques using large-scale visual models. This paper introduces a sophisticated scene image localization technique based on large models in a vast spatial sample environment. The study involved training convolutional neural networks using millions of geographically labeled images, extracting image position information using large model algorithms, and collecting sample data under various conditions in elastic scene space. Through visual computation, the shooting position of photos was inferred to obtain the approximate position information of users. This method utilizes geographic location information to classify images and combines it with landmarks, natural features, and architectural styles to determine their locations. The experimental results show variations in positioning accuracy among different models, with the most optimal model obtained through training on a large-scale dataset. They also indicate that the positioning error in urban street-based images is relatively small, whereas the positioning effect in outdoor and local scenes, especially in large-scale spatial environments, is limited. This suggests that the location information of users can be effectively determined through the utilization of geographic data, to classify images and incorporate landmarks, natural features, and architectural styles. The study’s experimentation indicates the variation in positioning accuracy among different models, highlighting the significance of training on a large-scale dataset for optimal results. Furthermore, it highlights the contrasting impact on urban street-based images versus outdoor and local scenes in large-scale spatial environments.


  • Not All Boxes Are Equal: Learning to Optimize Bounding Boxes With Discriminative Distributions in Optical Remote Sensing Images

    by Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Nicolas Vercheval, Aleksandra Pižurica

    Detecting oriented objects in optical remote sensing images has been consistently challenging due to difficulties in bounding boxes’ localization. The cascaded regression framework, widely used for high-quality bounding box refinement, has demonstrated effectiveness in this domain. However, our experiments reveal a discontinuity issue in bounding box optimization in cascaded regression framework. As a result, performance gain is not guaranteed across all stages in this framework. In this article, we propose a distribution discriminative detector (DDDet) to address the above issues and enhance the optimization of bounding boxes in oriented object detection. Specifically, a novel conditional anchor refinement framework (CARF) is designed to improve cascaded regression structure. CARF distinguishes bounding boxes with different distributions, adaptively optimizing them within the well-assigned regressors. Subsequently, the aligned convolution module (ACM) is integrated into each regressor, facilitating the continuous alignment between features and refined anchors. Furthermore, the geometry-guided training sample selection (GTSS) method is incorporated into CARF to assign labels based on object shape priors. Experimental results show that DDDet obtains state-of-the-art performance on mainstream datasets for oriented object detection in remote sensing image, which demonstrates the effectiveness of the proposed method. Our method surpasses many current single-stage detectors, two-stage detectors, and refine-stage detectors, achieving the mAP of 79.41% on the DOTA dataset and 44.15% on the FAIR1M dataset.


  • Open Access

    Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

    by Weiyi Chen, Lingjuan Miao, Yuhao Wang, Zhiqiang Zhou, Yajun Qiao

    Infrared–visible image fusion is valuable across various applications due to the complementary information that it provides. However, the current fusion methods face challenges in achieving high-quality fused images. This paper identifies a limitation in the existing fusion framework that affects the fusion quality: modal differences between infrared and visible images are often overlooked, resulting in the poor fusion of the two modalities. This limitation implies that features from different sources may not be consistently fused, which can impact the quality of the fusion results. Therefore, we propose a framework that utilizes feature-based decomposition and domain normalization. This decomposition method separates infrared and visible images into common and unique regions. To reduce modal differences while retaining unique information from the source images, we apply domain normalization to the common regions within the unified feature space. This space can transform infrared features into a pseudo-visible domain, ensuring that all features are fused within the same domain and minimizing the impact of modal differences during the fusion process. Noise in the source images adversely affects the fused images, compromising the overall fusion performance. Thus, we propose the non-local Gaussian filter. This filter can learn the shape and parameters of its filtering kernel based on the image features, effectively removing noise while preserving details. Additionally, we propose a novel dense attention in the feature extraction module, enabling the network to understand and leverage inter-layer information. Our experiments demonstrate a marked improvement in fusion quality with our proposed method.


  • Gradient Calibration Loss for Fast and Accurate Oriented Bounding Box Regression

    by Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Junjie Song, Aleksandra Pizurica

    Oriented object detection has a very wide range of application scenarios. In recent years, a lot of rotation detectors have been designed to achieve high-performance oriented object detection. Intersection-over-Union (IoU) is the commonly used indicator to evaluate the accuracy of detection performance. Many methods introduce IoU into the bounding box regression loss to achieve the aligned training and evaluation process for better performance. However, in this paper, we demonstrate several drawbacks of rotated IoU loss through both experiments and theoretical derivation: 1) There is a negative correlation between the loss gradient and the angular error. 2) The optimization process of rotated IoU loss suffers from scale sensitivity, which is not conducive to the model convergence. To solve the problems, we propose a Gradient Calibration Loss (GCL) that optimizes the rotated IoU loss via gradient analysis and correction. We construct the optimized gradient in GCL to avoid IoU loss oscillation and scale sensitivity, thereby accelerating model convergence. Models supervised by GCL have a more stable training process, faster convergence, and better performance. Moreover, GCL can be easily introduced into the existing rotation detectors to achieve performance gains without extra inference overhead. Extensive experiments on multiple oriented object detection datasets and models demonstrate the superiority of our method. Our method achieves state-of-the-art performance on the mainstream benchmark datasets. The source code and models are available at https://github.com/ming71/GCL.