Arbitrary-Scale Fusion Operator for High-Resolution Hyperspectral Imaging
- 26 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 28 (15209210) , 4219-4232
Abstract
For high-resolution hyperspectral (HrHs) imaging, spatial-spectral fusion offers a promising alternative to expensive equipment. However, retraining multiple models for varied scaling factors is currently unavoidable, costing extra computational resource and human labor. To address this issue, we propose Arbitrary-scale Fusion Operator (AFO), a lightweight solution for HrHs fusion given arbitrary scalings, turning the retraining strategy into “training-free” ones. Specifically, AFO treats low-resolution hyperspectral (LrHs) images and high resolution multispectral (HrMs) images as light-wise degraded functions within the spectrum, which are initially embedded into a high-dimensional space to simulate the original light signals, tapping the potential of enriched prior learning. Then, a flow of kernel integration (KI) is meticulously crafted, followed by a rival step of dimension reduction for HrHs generation. For a well-behaved KI computation, an Attention-Driven Convolution Integration (ADCI) is engineered to restore the broken discretization invariance derived by convolutions, yet with the locally inductive bias preserved. In addition, we propose an Implicit Neural Functional Integration (INFI) to achieve cross domain interaction of spatial degradation functions, followed by the use of Galerkin-type Integration (GI) as a decoder to handle high-frequency information. Finally, the bonded activation functions are improved for the principle of continuous-discrete equivalence. Extensive experiments validate the superiority of our approach over cutting-edge methods. Notably, our proposal holds significantly better generalization on arbitrary scaling factors, yet requires only 0.07M parameters.Keywords
Funding Information
- Key Program of Natural Science Foundation of Zhejiang Province (LZ24F030012)
- National Natural Science Foundation of China (62276232)
- National Natural Science Foundation of China (62406285)
- China Postdoctoral Science Foundation (ZY24211190002)
- Natural Science Foundation of Zhejiang Province (LMS25F020006)
This publication has 37 references indexed in Scilit:
- A General Paradigm with Detail-Preserving Conditional Invertible Network for Image FusionInternational Journal of Computer Vision, 2023
- Super-Resolution Neural Operator2023
- Tensor completion via hybrid shallow-and-deep priorsApplied Intelligence, 2022
- Local Texture Estimator for Implicit Representation Function2022
- Integrating remote sensing with ecology and evolution to advance biodiversity conservationNature Ecology & Evolution, 2022
- Learning Continuous Image Representation with Local Implicit Image Function2021
- Learning nonlinear operators via DeepONet based on the universal approximation theorem of operatorsNature Machine Intelligence, 2021
- Deep Blind Hyperspectral Image Fusion2019
- Enhanced Deep Residual Networks for Single Image Super-Resolution2017
- Image Quality Metrics: PSNR vs. SSIM2010