XYXiaofei Yu

Xiaofei Yu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Xiaofei Yu has a total of 7 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • KD-RSCC: A Karras Diffusion Framework for Efficient Remote Sensing Change Captioning

    by Xiaofei Yu, Jie Ma, Liqiang Qiao

    Remote sensing image change captioning (RSICC) is a challenging task that involves describing surface changes between bitemporal or multitemporal satellite images using natural language. This task requires both fine-grained visual understanding and expressive language generation. Transformer-based and long short-term memory (LSTM)-based models have shown promising results in this domain. However, they may encounter difficulties in generating flexible and diverse captions, particularly when training data are limited or imbalanced. While diffusion models provide richer textual outputs, they are often constrained by long inference times. To address these issues, we propose a novel diffusion-based framework, KD-RSCC, for efficient and expressive remote sensing change captioning. This framework utilizes the Karras sampling method to significantly reduce the number of steps required during inference, while preserving the quality and diversity of the generated captions. In addition, we introduce a large language model (LLM)-based evaluation strategy $\text {G-Eval}_{\text {RSCC}}$ to conduct a more comprehensive assessment of the semantic accuracy, fluency, and linguistic diversity of the generated descriptions. Experimental results demonstrate that KD-RSCC achieves an optimal balance between generation quality and inference speed, enhancing the flexibility and readability of its outputs. The code and supplementary materials are available at https://github.com/Fay-Y/KD_RSCC

  • Diffusion-RSCC: Diffusion Probabilistic Model for Change Captioning in Remote Sensing Images

    by Xiaofei Yu, Yitong Li, Jie Ma, Chang Li, Hanlin Wu

    Remote sensing image change captioning (RSICC) aims at generating human-like language to describe the semantic changes between bi-temporal remote sensing image pairs. It provides valuable insight into environmental dynamics and land management. Unlike conventional change captioning tasks, RSICC involves not only retrieving relevant information across different modalities and generating fluent captions, but also mitigating the impact of pixel-level differences on terrain change localization. Pixel-level discrepancies over long time spans decrease caption accuracy. To address these problems, we propose a probabilistic diffusion-based model that leverages its remarkable generative capability to produce flexible captions. In the training phase, we construct a Condition Denoiser to efficiently map the real caption distribution to a standard Gaussian distribution. This denoiser incorporates Cross-Mode Fusion and Stacking Self-Attention modules to enhance cross-modal alignment and reduce pixel interference, thereby improving caption accuracy. In the training phase, the Condition Denoiser provides a new strategy for mean value estimation and helps to generate captions step by step. Extensive experiments on the LEVIR-CC dataset and DUBAI-CC dataset demonstrate the effectiveness of our Diffusion-RSCC and each of its individual components. The quantitative results showcase superior performance over existing methods across both traditional and newly introduced metrics. The code is available at https://github.com/Fay-Y/Diffusion- RSCC.