Tao Huang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Tao Huang has a total of 46 co-authors. Here are the top co-authors by number of shared publications:
- Weisheng Dong
School of Artificial Intelligence, Xidian University, Xi’an, China
14 shared publications - Fangfang Wu
School of Computer Science and Technology, Xidian University, Xian, China
7 shared publications - Guangming Shi
Peng Cheng Laboratory, Shenzhen, Guangdong, China
7 shared publications - Junwei Xu
School of Artificial Intelligence, Xidian University, Xian, China
7 shared publications - Zhenyu Wang
Hangzhou Institute of Technology, Xidian University, Hangzhou, China
7 shared publications - Xin Li
State University of New York at Albany, Albany, NY, USA
5 shared publications
Latest Publications
- 14 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35 (10577149) , 5224-5238
Uncertainty-Driven Generative Prior Learning for Sparse Model-Guided Hyperspectral Image Fusion
s an alternative to acquiring high-resolution hyperspectral images (HR-HSI), Hyperspectral Image Fusion (HIF) aims to recover clean HR-HSIs by fusing degraded low spatial resolution hyperspectral images and high spatial resolution multispectral images. Existing model-guided HIF methods elegantly integrate physical degradation constraints with the powerful learning capabilities of data-driven networks.s an alternative to acquiring high-resolution hyperspectral images (HR-HSI), Hyperspectral Image Fusion (HIF) aims to recover clean HR-HSIs by fusing degraded low spatial resolution hyperspectral images and high spatial resolution multispectral images. Existing model-guided HIF methods elegantly integrate physical degradation constraints with the powerful learning capabilities of data-driven networks.A However, these methods struggle with severe, unseen degradations, as their deep priors are trained on degraded-clean pairs and thus lack knowledge of clean HSI characteristics. To address these issues, we introduce a Vector-Quantized Prior-Guided Network (VPG-Net), which incorporates a novel uncertainty-driven generative model prior alongside a traditional sparse representation prior. Specifically, VPG-Net unfolds the Maximum A Posteriori (MAP) estimation with a sparse representation model into an uncertainty-aware generative prior-guided network implementation. The sparse representation prior is integrated into the MAP framework to improve noise resistance, whose solution is implemented as a trainable neural network. As the core of our contribution, we leverage a high-quality vector-quantized (VQ) prior, which serves as a powerful degradation-free generative prior for the HIF process. Specifically, we pre-train a discrete codebook and encoder from clean HR-HSIs to generate a VQ-prior representation (VQPR), which preserves complete spatial-spectral information. To effectively bridge the gap between degraded inputs and the learned degradation-free codebook, we incorporate a novel uncertainty-driven probabilistic matching strategy that robustly aligns features and prevents artifacts. The learned VQPR is then incorporated into the reconstruction model as dynamic modulation parameters to enhance the fidelity and realism of the reconstructed results, particularly for severely degraded inputs. Extensive experiments on clean and degraded synthetic and real-world datasets demonstrate that our approach outperforms state-of- the-art HIF methods in both quantitative metrics and visual quality.
- 14 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35 (10577149) , 5224-5238
Uncertainty-Driven Generative Prior Learning for Sparse Model-Guided Hyperspectral Image Fusion
s an alternative to acquiring high-resolution hyperspectral images (HR-HSI), Hyperspectral Image Fusion (HIF) aims to recover clean HR-HSIs by fusing degraded low spatial resolution hyperspectral images and high spatial resolution multispectral images. Existing model-guided HIF methods elegantly integrate physical degradation constraints with the powerful learning capabilities of data-driven networks.s an alternative to acquiring high-resolution hyperspectral images (HR-HSI), Hyperspectral Image Fusion (HIF) aims to recover clean HR-HSIs by fusing degraded low spatial resolution hyperspectral images and high spatial resolution multispectral images. Existing model-guided HIF methods elegantly integrate physical degradation constraints with the powerful learning capabilities of data-driven networks.A However, these methods struggle with severe, unseen degradations, as their deep priors are trained on degraded-clean pairs and thus lack knowledge of clean HSI characteristics. To address these issues, we introduce a Vector-Quantized Prior-Guided Network (VPG-Net), which incorporates a novel uncertainty-driven generative model prior alongside a traditional sparse representation prior. Specifically, VPG-Net unfolds the Maximum A Posteriori (MAP) estimation with a sparse representation model into an uncertainty-aware generative prior-guided network implementation. The sparse representation prior is integrated into the MAP framework to improve noise resistance, whose solution is implemented as a trainable neural network. As the core of our contribution, we leverage a high-quality vector-quantized (VQ) prior, which serves as a powerful degradation-free generative prior for the HIF process. Specifically, we pre-train a discrete codebook and encoder from clean HR-HSIs to generate a VQ-prior representation (VQPR), which preserves complete spatial-spectral information. To effectively bridge the gap between degraded inputs and the learned degradation-free codebook, we incorporate a novel uncertainty-driven probabilistic matching strategy that robustly aligns features and prevents artifacts. The learned VQPR is then incorporated into the reconstruction model as dynamic modulation parameters to enhance the fidelity and realism of the reconstructed results, particularly for severely degraded inputs. Extensive experiments on clean and degraded synthetic and real-world datasets demonstrate that our approach outperforms state-of- the-art HIF methods in both quantitative metrics and visual quality.
- 13 February 2026
- Published by Elsevier in Pattern Recognition
- Vol. 177
Visible-infrared joint image deraining for harsh rain conditions with cross-modal semantic consistency
- 13 February 2026
- Published by Elsevier in Pattern Recognition
- Vol. 177
Visible-infrared joint image deraining for harsh rain conditions with cross-modal semantic consistency
- 16 January 2026
- Published by Elsevier in Neural Networks
- Vol. 198, 108607
CoCoFR: Collaborative codebooks learning with soft matching strategy for blind face restoration
- 16 January 2026
- Published by Elsevier in Neural Networks
- Vol. 198, 108607
CoCoFR: Collaborative codebooks learning with soft matching strategy for blind face restoration
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 10211-10225
DecMoiré: Decoupled Illumination Modulation and Moiré Removal for Robust Image Demoiréing
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 10211-10225
DecMoiré: Decoupled Illumination Modulation and Moiré Removal for Robust Image Demoiréing
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64, 5526814
Uncertainty-Driven Cyclic Background Purification for Hyperspectral Anomaly Detection
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64, 5526814
Uncertainty-Driven Cyclic Background Purification for Hyperspectral Anomaly Detection
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 1
LoopExpose: An Unsupervised Framework for Arbitrary-Length Exposure Correction
Exposure correction is essential for enhancing image quality under challenging lighting conditions. While supervised learning has achieved significant progress in this area, it relies heavily on large-scale labeled datasets, which are difficult to obtain in practical scenarios. To address this limitation, we propose a pseudo label-based unsupervised method called LoopExpose for arbitrary-length exposure correction. A nested loop optimization strategy is proposed to address the exposure correction problem, where the correction model and pseudo-supervised information are jointly optimized in a two-level framework. Specifically, the upper-level trains a correction model using pseudo-labels generated through multi-exposure fusion at the lower level. A feedback mechanism is introduced where corrected images are fed back into the fusion process to refine the pseudo-labels, creating a self-reinforcing learning loop. Considering the dominant role of luminance calibration in exposure correction, a Luminance Ranking Loss is introduced to leverage the relative luminance ordering across the input sequence as a self-supervised constraint. Extensive experiments on different benchmark datasets demonstrate that LoopExpose achieves superior exposure correction and fusion performance, outperforming existing state-of-the-art unsupervised methods. Code is available at https://github.com/FALALAS/LoopExpose.
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 1
LoopExpose: An Unsupervised Framework for Arbitrary-Length Exposure Correction
Exposure correction is essential for enhancing image quality under challenging lighting conditions. While supervised learning has achieved significant progress in this area, it relies heavily on large-scale labeled datasets, which are difficult to obtain in practical scenarios. To address this limitation, we propose a pseudo label-based unsupervised method called LoopExpose for arbitrary-length exposure correction. A nested loop optimization strategy is proposed to address the exposure correction problem, where the correction model and pseudo-supervised information are jointly optimized in a two-level framework. Specifically, the upper-level trains a correction model using pseudo-labels generated through multi-exposure fusion at the lower level. A feedback mechanism is introduced where corrected images are fed back into the fusion process to refine the pseudo-labels, creating a self-reinforcing learning loop. Considering the dominant role of luminance calibration in exposure correction, a Luminance Ranking Loss is introduced to leverage the relative luminance ordering across the input sequence as a self-supervised constraint. Extensive experiments on different benchmark datasets demonstrate that LoopExpose achieves superior exposure correction and fusion performance, outperforming existing state-of-the-art unsupervised methods. Code is available at https://github.com/FALALAS/LoopExpose.
- 22 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 8552-8567
Cross-Frequency Attention and Color Contrast Constraint for Remote Sensing Dehazing
Current deep learning-based methods for remote sensing image dehazing have developed rapidly, yet they still commonly struggle to simultaneously preserve fine texture details and restore accurate colors. The fundamental reason lies in the insufficient modeling of high-frequency information that captures structural details, as well as the lack of effective constraints for color restoration. To address the insufficient modeling of global high-frequency information, we first develop an omni-directional high-frequency feature inpainting mechanism that leverages the wavelet transform to extract multi-directional high-frequency components. While maintaining the advantage of linear complexity, it models global long-range texture dependencies through cross-frequency perception. Then, to further strengthen local high-frequency representation, we design a high-frequency prompt attention module that dynamically injects wavelet-domain optimized high-frequency features as cross-level guidance signals, significantly enhancing the model’s capability in edge sharpness restoration and texture detail reconstruction. Further, to alleviate the problem of inaccurate color restoration, we propose a color contrast loss function based on the HSV color space, which explicitly models the statistical distribution differences of brightness and saturation in hazy regions, guiding the model to generate dehazed images with consistent colors and natural visual appearance. Finally, extensive experiments on multiple benchmark datasets demonstrate that the proposed method outperforms existing approaches in both texture detail restoration and color consistency. Further results and code available at: https://github.com/fyxnl/C4RSD.
- 22 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 8552-8567
Cross-Frequency Attention and Color Contrast Constraint for Remote Sensing Dehazing
Current deep learning-based methods for remote sensing image dehazing have developed rapidly, yet they still commonly struggle to simultaneously preserve fine texture details and restore accurate colors. The fundamental reason lies in the insufficient modeling of high-frequency information that captures structural details, as well as the lack of effective constraints for color restoration. To address the insufficient modeling of global high-frequency information, we first develop an omni-directional high-frequency feature inpainting mechanism that leverages the wavelet transform to extract multi-directional high-frequency components. While maintaining the advantage of linear complexity, it models global long-range texture dependencies through cross-frequency perception. Then, to further strengthen local high-frequency representation, we design a high-frequency prompt attention module that dynamically injects wavelet-domain optimized high-frequency features as cross-level guidance signals, significantly enhancing the model’s capability in edge sharpness restoration and texture detail reconstruction. Further, to alleviate the problem of inaccurate color restoration, we propose a color contrast loss function based on the HSV color space, which explicitly models the statistical distribution differences of brightness and saturation in hazy regions, guiding the model to generate dehazed images with consistent colors and natural visual appearance. Finally, extensive experiments on multiple benchmark datasets demonstrate that the proposed method outperforms existing approaches in both texture detail restoration and color consistency. Further results and code available at: https://github.com/fyxnl/C4RSD.
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 8672-8683
Incomplete Modalities Restoration via Hierarchical Adaptation for Robust Multimodal Segmentation
Multimodal semantic segmentation has significantly advanced the field of semantic segmentation by integrating data from multiple sources. However, this task often encounters missing modality scenarios due to challenges such as sensor failures or data transmission errors, which can result in substantial performance degradation. Existing approaches to addressing missing modalities predominantly involve training separate models tailored to specific missing scenarios, typically requiring considerable computational resources. In this paper, we propose a Hierarchical Adaptation framework to Restore Missing Modalities for Multimodal segmentation (HARM3), which enables frozen pretrained multimodal models to be directly applied to missing-modality semantic segmentation tasks with minimal parameter updates. Central to HARM3 is a text-instructed missing modality prompt module, which learns multimodal semantic knowledge by utilizing available modalities and textual instructions to generate prompts for the missing modalities. By incorporating a small set of trainable parameters, this module effectively facilitates knowledge transfer between high-resource domains and low-resource domains where missing modalities are more prevalent. Besides, to further enhance the model’s robustness and adaptability, we introduce adaptive perturbation training and an affine modality adapter. Extensive experimental results demonstrate the effectiveness and robustness of HARM3 across a variety of missing modality scenarios.
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 8672-8683
Incomplete Modalities Restoration via Hierarchical Adaptation for Robust Multimodal Segmentation
Multimodal semantic segmentation has significantly advanced the field of semantic segmentation by integrating data from multiple sources. However, this task often encounters missing modality scenarios due to challenges such as sensor failures or data transmission errors, which can result in substantial performance degradation. Existing approaches to addressing missing modalities predominantly involve training separate models tailored to specific missing scenarios, typically requiring considerable computational resources. In this paper, we propose a Hierarchical Adaptation framework to Restore Missing Modalities for Multimodal segmentation (HARM3), which enables frozen pretrained multimodal models to be directly applied to missing-modality semantic segmentation tasks with minimal parameter updates. Central to HARM3 is a text-instructed missing modality prompt module, which learns multimodal semantic knowledge by utilizing available modalities and textual instructions to generate prompts for the missing modalities. By incorporating a small set of trainable parameters, this module effectively facilitates knowledge transfer between high-resource domains and low-resource domains where missing modalities are more prevalent. Besides, to further enhance the model’s robustness and adaptability, we introduce adaptive perturbation training and an affine modality adapter. Extensive experimental results demonstrate the effectiveness and robustness of HARM3 across a variety of missing modality scenarios.
- 26 November 2025
- Published by Elsevier in Information Fusion
- Vol. 129
Exploring structured uncertainty for external prior-guided hyperspectral image fusion
- 26 November 2025
- Published by Elsevier in Information Fusion
- Vol. 129
Exploring structured uncertainty for external prior-guided hyperspectral image fusion