CrosSeR: Collaborative Learning for Generalizable Cross-Device Image Super-Resolution via Amplitude Spectrum Sharing

Authors:
  • YYYue Yang
    Yue Yang
  • YXYunqiu Xu
    Yunqiu Xu
  • ALAnran Li
    Anran Li
  • SQSaiyu Qi
    Saiyu Qi

Abstract
Recent advances in image super-resolution (SR) have enabled high-fidelity reconstruction, yet existing models still underperform on real-world devices due to a distribution gap between public training datasets and personal images. In this study, we investigate a practical yet under-explored scenario, cross-device image SR, where a shared SR model is federatively constructed across multiple devices and endowed with generalization capacity to unseen devices. This new task brings two key challenges: 1) effectively learning from the limited data on individual devices, and 2) developing a generic SR model capable of robustly generalizing to unseen devices. To address these issues, we propose CrosSeR, a novel collaborative learning SR framework. Specifically, an amplitude-mixed curation strategy is first introduced to enrich data diversity on each device. This involves extracting the amplitude and phase spectra of images in the frequency domain, and combining the device’s own phase with amplitude sampled from other devices to enlarge both diversity and scale. The amplitude spectra are globally shared across devices as they do not reveal visual content but contribute to appearance variations. Furthermore, we devise a bi-level joint learning scheme comprising within-device training and cross-device adaptation. This scheme leverages both original and augmented samples to guide the transition from device-specific to device-invariant representation learning. By ensembling the device-specific models, CrosSeR ultimately develops a generic image SR model that effectively generalizes to arbitrary unseen devices. Extensive experiments on two real-world SR benchmarks demonstrate the effectiveness of CrosSeR in achieving both high-quality image reconstruction and strong generalization performance.

This publication has 17 references indexed in Scilit: