Faster and Better: Reinforced Collaborative Distillation and Self-Learning for Infrared-Visible Image Fusion
Preprint
Abstract
Infrared and visible image fusion plays a critical role in enhancing scene perception by combining complementary information from different modalities. Despite recent advances, achieving high-quality image fusion with lightweight models remains a significant challenge. To bridge this gap, we propose a novel collaborative distillation and self-learning framework for image fusion driven by reinforcement learning. Unlike conventional distillation, this approach not only enables the student model to absorb image fusion knowledge from the teacher model, but more importantly, allows the student to perform self-learning on more challenging samples to enhance its capabilities. Particularly, in our framework, a reinforcement learning agent explores and identifies a more suitable training strategy for the student. The agent takes both the student's performance and the teacher-student gap as inputs, which leads to the generation of challenging samples to facilitate the student's self-learning. Simultaneously, it dynamically adjusts the teacher's guidance strength based on the student's state to optimize the knowledge transfer. Experimental results demonstrate that our method can significantly improve student performance and achieve better fusion results compared to existing techniques.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- KDFuse: A high-level vision task-driven infrared and visible image fusion method based on cross-domain knowledge distillationInformation Fusion, 2025
- DDBFusion: An unified image decomposition and fusion framework based on dual decomposition and Bézier curvesInformation Fusion, 2024
- A Novel Teacher–Student Framework With Degradation Model for Infrared–Visible Image FusionIEEE Transactions on Instrumentation and Measurement, 2024
- AFT: Adaptive Fusion Transformer for Visible and Infrared ImagesIEEE Transactions on Image Processing, 2023
- PIAFusion: A progressive infrared and visible image fusion network based on illumination awareInformation Fusion, 2022
- DenseFuse: A Fusion Approach to Infrared and Visible ImagesIEEE Transactions on Image Processing, 2018
- The TNO Multiband Image Data CollectionData in Brief, 2017
- Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decompositionOptics Communications, 2015
- A new image fusion performance metric based on visual information fidelityInformation Fusion, 2013
- Image information and visual qualityIEEE Transactions on Image Processing, 2006