Haiwei Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Haiwei Li has a total of 54 co-authors. Here are the top co-authors by number of shared publications:
- Geng Zhang
Key Laboratory of Spectral Imaging Technology of CAS, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
7 shared publications - Bingliang Hu
Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
5 shared publications - Junyu Chen
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
5 shared publications - Liyao Song
School of Information and Communications Engineering, Xi’an Jiaotong University, Xi’an 710049, China
5 shared publications - Jiancun Fan
School of Information and Communications Engineering, Xian Jiaotong University, Xian, Shaanxi, China
4 shared publications - Quan Wang
Key Laboratory of Biomedical Spectroscopy of Xi’an, Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics (XIOPM), Chinese Academy of Sciences, Xi’an 710119, China
4 shared publications
Latest Publications
- Open Access
- 3 July 2026
- Published by MDPI AG in Remote Sensing
- Vol. 18 (13) , 2156
Diffusion-Driven Relative Radiometric Normalization with Spatial–Spectral Attention Residual Network for Multi-Temporal Remote Sensing Imagery
Relative radiometric normalization (RRN) is fundamental to multi-temporal remote sensing analysis; however, conventional techniques often struggle with nonlinear distortions, outlier contamination, and heterogeneous land-cover conditions. To address these challenges, we propose a diffusion-based probabilistic framework that models radiometric inconsistency as a combination of deterministic residuals and stochastic perturbations. In this framework, the forward process injects structured noise and stochastic perturbations, while the reverse process restores radiometric consistency through a dual-objective variational formulation. At the core of this framework is a spatial–spectral attention residual network (SSARN), which integrates residual learning with dual attention mechanisms to capture cross-band dependencies and multi-scale spatial context. A preprocessing stage guided by the structural similarity index (SSIM) further enhances robustness by automatically selecting stable pseudo-invariant regions for model training. Comprehensive experiments on multi-temporal Sentinel-2 datasets demonstrate that the proposed method consistently outperforms existing approaches, achieving higher accuracy and enhanced spectral fidelity. Moreover, the framework ensures greater consistency of the normalized difference vegetation index (NDVI) and preserves fine-grained textural details, underscoring its potential as a scalable and resilient solution for large-scale RRN in remote sensing applications.
- 3 July 2026
- Published by MDPI AG in Remote Sensing
- Vol. 18 (13) , 2156
Open AccessDiffusion-Driven Relative Radiometric Normalization with Spatial–Spectral Attention Residual Network for Multi-Temporal Remote Sensing Imagery
Relative radiometric normalization (RRN) is fundamental to multi-temporal remote sensing analysis; however, conventional techniques often struggle with nonlinear distortions, outlier contamination, and heterogeneous land-cover conditions. To address these challenges, we propose a diffusion-based probabilistic framework that models radiometric inconsistency as a combination of deterministic residuals and stochastic perturbations. In this framework, the forward process injects structured noise and stochastic perturbations, while the reverse process restores radiometric consistency through a dual-objective variational formulation. At the core of this framework is a spatial–spectral attention residual network (SSARN), which integrates residual learning with dual attention mechanisms to capture cross-band dependencies and multi-scale spatial context. A preprocessing stage guided by the structural similarity index (SSIM) further enhances robustness by automatically selecting stable pseudo-invariant regions for model training. Comprehensive experiments on multi-temporal Sentinel-2 datasets demonstrate that the proposed method consistently outperforms existing approaches, achieving higher accuracy and enhanced spectral fidelity. Moreover, the framework ensures greater consistency of the normalized difference vegetation index (NDVI) and preserves fine-grained textural details, underscoring its potential as a scalable and resilient solution for large-scale RRN in remote sensing applications.
- 1 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Dilated Transformation-Guided Unsupervised Multimodal Learning for Hyperspectral and Multispectral Image Fusion
Multimodal fusion widely uses convolutional layers to capture local correlations and adjust feature dimensions. However, the progressive expansion of the receptive field in convolutional layers often compromises spatial context retention, leading to the loss of fine details. Furthermore, the fixed-size kernels typically used in standard convolution restrict the network’s ability to capture multiscale contextual details. To address this limitation, this paper develops a dilated transformation-guided unsupervised multimodal learning (DTUML) method to fuse a high-resolution multispectral image (HR-MSI) and a low-resolution hyperspectral image (LR-HSI), thereby generating a high-resolution hyperspectral image (HR-HSI). Our DTUML adopts a dual-stream encoder architecture to conduct multimodal data, where one stream focuses on preserving spectral information from LR-HSIs, while the other emphasizes the acquisition of spatial details from HR-MSIs. These complementary features are subsequently integrated to ensure spectral fidelity and retain spatial detail. Then, a convolutional layer restores dimensional consistency and outputs an HR-HSI. Extensive experiments demonstrate the effectiveness of DTUML, showing superior performance and strong competitiveness compared to state-of-the-art methods. Code: https://github.com/yuanchaosu/TGRS-DTUML.
- 1 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Dilated Transformation-Guided Unsupervised Multimodal Learning for Hyperspectral and Multispectral Image Fusion
Multimodal fusion widely uses convolutional layers to capture local correlations and adjust feature dimensions. However, the progressive expansion of the receptive field in convolutional layers often compromises spatial context retention, leading to the loss of fine details. Furthermore, the fixed-size kernels typically used in standard convolution restrict the network’s ability to capture multiscale contextual details. To address this limitation, this paper develops a dilated transformation-guided unsupervised multimodal learning (DTUML) method to fuse a high-resolution multispectral image (HR-MSI) and a low-resolution hyperspectral image (LR-HSI), thereby generating a high-resolution hyperspectral image (HR-HSI). Our DTUML adopts a dual-stream encoder architecture to conduct multimodal data, where one stream focuses on preserving spectral information from LR-HSIs, while the other emphasizes the acquisition of spatial details from HR-MSIs. These complementary features are subsequently integrated to ensure spectral fidelity and retain spatial detail. Then, a convolutional layer restores dimensional consistency and outputs an HR-HSI. Extensive experiments demonstrate the effectiveness of DTUML, showing superior performance and strong competitiveness compared to state-of-the-art methods. Code: https://github.com/yuanchaosu/TGRS-DTUML.
- 26 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
FusGAT: Graph Attention-Based Fusion Network for Unsupervised Hyperspectral Image Super-Resolution
Unsupervised hyperspectral image super-resolution (HSI-SR) has recently emerged as a popular and active research topic in remote sensing data fusion. However, most methods neglect the non-local features of the data in representation learning, which limits their fusion performances. To overcome the issue, we propose a Graph Attention-based Fusion Network (FusGAT) in this letter. This approach first extracts local features from the input data using multi-scale convolutions, and then the graph attention mechanism is employed to model relationships between nodes in the spectral stream for deriving non-local features of the image and transferring them to the spatial stream. FusGAT will iteratively update the node connections and refine node embedding, facilitating the extraction of non-local features and enabling effective information flow between the streams. We conducted several experiments on two datasets to prove the effectiveness of the proposed method. The source code will be available at: https://github.com/yuanchaosu/FusGAT-GRSL.
- 26 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
FusGAT: Graph Attention-Based Fusion Network for Unsupervised Hyperspectral Image Super-Resolution
Unsupervised hyperspectral image super-resolution (HSI-SR) has recently emerged as a popular and active research topic in remote sensing data fusion. However, most methods neglect the non-local features of the data in representation learning, which limits their fusion performances. To overcome the issue, we propose a Graph Attention-based Fusion Network (FusGAT) in this letter. This approach first extracts local features from the input data using multi-scale convolutions, and then the graph attention mechanism is employed to model relationships between nodes in the spectral stream for deriving non-local features of the image and transferring them to the spatial stream. FusGAT will iteratively update the node connections and refine node embedding, facilitating the extraction of non-local features and enabling effective information flow between the streams. We conducted several experiments on two datasets to prove the effectiveness of the proposed method. The source code will be available at: https://github.com/yuanchaosu/FusGAT-GRSL.
- Open Access
- 28 February 2025
- Published by MDPI AG in Remote Sensing
- Vol. 17 (5) , 863
Multi-Level Spectral Attention Network for Hyperspectral BRDF Reconstruction from Multi-Angle Multi-Spectral Images
With the rapid development of hyperspectral applications using unmanned aerial vehicles (UAVs), the traditional assumption that ground objects exhibit Lambertian reflectance is no longer sufficient to meet the high-precision requirements for quantitative inversion and airborne hyperspectral data applications. Therefore, it is necessary to establish a hyperspectral bidirectional reflectance distribution function (BRDF) model suitable for the area of imaging. However, obtaining multi-angle information from UAV push-broom hyperspectral data is difficult. Achieving uniform push-broom imaging and flexibly acquiring multi-angle data is challenging due to spatial distortions, particularly under heightened roll or pitch angles, and the need for multiple flights; this extends acquisition time and exacerbates uneven illumination, introducing errors in BRDF model construction. To address these issues, we propose leveraging the advantages of multi-spectral cameras, such as their compact size, lightweight design, and high signal-to-noise ratio (SNR) to reconstruct hyperspectral multi-angle data. This approach enhances spectral resolution and the number of bands while mitigating spatial distortions and effectively captures the multi-angle characteristics of ground objects. In this study, we collected UAV hyperspectral multi-angle data, corresponding illumination information, and atmospheric parameter data, which can solve the problem of existing BRDF modeling not considering outdoor ambient illumination changes, as this limits modeling accuracy. Based on this dataset, we propose an improved Walthall model, considering illumination variation. Then, the radiance consistency of BRDF multi-angle data is effectively optimized, the error caused by illumination variation in BRDF modeling is reduced, and the accuracy of BRDF modeling is improved. In addition, we adopted Transformer for spectral reconstruction, increased the number of bands on the basis of spectral dimension enhancement, and conducted BRDF modeling based on the spectral reconstruction results. For the multi-level Transformer spectral dimension enhancement algorithm, we added spectral response loss constraints to improve BRDF accuracy. In order to evaluate BRDF modeling and quantitative application potential from the reconstruction results, we conducted comparison and ablation experiments. Finally, we solved the problem of difficulty in obtaining multi-angle information due to the limitation of hyperspectral imaging equipment, and we provide a new solution for obtaining multi-angle features of objects with higher spectral resolution using low-cost imaging equipment.
- 28 February 2025
- Published by MDPI AG in Remote Sensing
- Vol. 17 (5) , 863
Open AccessMulti-Level Spectral Attention Network for Hyperspectral BRDF Reconstruction from Multi-Angle Multi-Spectral Images
With the rapid development of hyperspectral applications using unmanned aerial vehicles (UAVs), the traditional assumption that ground objects exhibit Lambertian reflectance is no longer sufficient to meet the high-precision requirements for quantitative inversion and airborne hyperspectral data applications. Therefore, it is necessary to establish a hyperspectral bidirectional reflectance distribution function (BRDF) model suitable for the area of imaging. However, obtaining multi-angle information from UAV push-broom hyperspectral data is difficult. Achieving uniform push-broom imaging and flexibly acquiring multi-angle data is challenging due to spatial distortions, particularly under heightened roll or pitch angles, and the need for multiple flights; this extends acquisition time and exacerbates uneven illumination, introducing errors in BRDF model construction. To address these issues, we propose leveraging the advantages of multi-spectral cameras, such as their compact size, lightweight design, and high signal-to-noise ratio (SNR) to reconstruct hyperspectral multi-angle data. This approach enhances spectral resolution and the number of bands while mitigating spatial distortions and effectively captures the multi-angle characteristics of ground objects. In this study, we collected UAV hyperspectral multi-angle data, corresponding illumination information, and atmospheric parameter data, which can solve the problem of existing BRDF modeling not considering outdoor ambient illumination changes, as this limits modeling accuracy. Based on this dataset, we propose an improved Walthall model, considering illumination variation. Then, the radiance consistency of BRDF multi-angle data is effectively optimized, the error caused by illumination variation in BRDF modeling is reduced, and the accuracy of BRDF modeling is improved. In addition, we adopted Transformer for spectral reconstruction, increased the number of bands on the basis of spectral dimension enhancement, and conducted BRDF modeling based on the spectral reconstruction results. For the multi-level Transformer spectral dimension enhancement algorithm, we added spectral response loss constraints to improve BRDF accuracy. In order to evaluate BRDF modeling and quantitative application potential from the reconstruction results, we conducted comparison and ablation experiments. Finally, we solved the problem of difficulty in obtaining multi-angle information due to the limitation of hyperspectral imaging equipment, and we provide a new solution for obtaining multi-angle features of objects with higher spectral resolution using low-cost imaging equipment.
- Open Access
- 31 March 2024
- Published by MDPI AG in Remote Sensing
- Vol. 16 (7) , 1248
Fusion of Hyperspectral and Multispectral Images with Radiance Extreme Area Compensation
Although the fusion of multispectral (MS) and hyperspectral (HS) images in remote sensing has become relatively mature, and different types of fusion methods have their own characteristics in terms of fusion effect, data dependency, and computational efficiency, few studies have focused on the impact of radiance extreme areas, which widely exist in real remotely sensed scenes. To this end, this paper proposed a novel method called radiance extreme area compensation fusion (RECF). Based on the architecture of spectral unmixing fusion, our method uses the reconstruction of error map to construct local smoothing constraints during unmixing and utilizes the nearest-neighbor multispectral data to achieve optimal replacement compensation, thereby eliminating the impact of overexposed and underexposed areas in hyperspectral data on the fusion effect. We compared the RECF method with 11 previous published methods on three sets of airborne hyperspectral datasets and HJ2 satellite hyperspectral data and quantitatively evaluated them using 5 metrics, including PSNR and SAM. On the test dataset with extreme radiance interference, the proposed RECF method achieved well in the overall evaluation results; for instance, the PSNR metric reached 47.6076 and SAM reached 0.5964 on the Xiong’an dataset. In addition, the result shows that our method also achieved better visual effects on both simulation and real datasets.
- 31 March 2024
- Published by MDPI AG in Remote Sensing
- Vol. 16 (7) , 1248
Open AccessFusion of Hyperspectral and Multispectral Images with Radiance Extreme Area Compensation
Although the fusion of multispectral (MS) and hyperspectral (HS) images in remote sensing has become relatively mature, and different types of fusion methods have their own characteristics in terms of fusion effect, data dependency, and computational efficiency, few studies have focused on the impact of radiance extreme areas, which widely exist in real remotely sensed scenes. To this end, this paper proposed a novel method called radiance extreme area compensation fusion (RECF). Based on the architecture of spectral unmixing fusion, our method uses the reconstruction of error map to construct local smoothing constraints during unmixing and utilizes the nearest-neighbor multispectral data to achieve optimal replacement compensation, thereby eliminating the impact of overexposed and underexposed areas in hyperspectral data on the fusion effect. We compared the RECF method with 11 previous published methods on three sets of airborne hyperspectral datasets and HJ2 satellite hyperspectral data and quantitatively evaluated them using 5 metrics, including PSNR and SAM. On the test dataset with extreme radiance interference, the proposed RECF method achieved well in the overall evaluation results; for instance, the PSNR metric reached 47.6076 and SAM reached 0.5964 on the Xiong’an dataset. In addition, the result shows that our method also achieved better visual effects on both simulation and real datasets.
- Open Access
- 31 January 2024
- Published by MDPI AG in Remote Sensing
- Vol. 16 (3) , 543
Methodology and Modeling of UAV Push-Broom Hyperspectral BRDF Observation Considering Illumination Correction
The Bidirectional Reflectance Distribution Function (BRDF) is a critical spatial distribution parameter in the quantitative research of remote sensing and has a wide range of applications in radiometric correction, elemental inversion, and surface feature estimation. As a new means of BRDF modeling, UAV push-broom hyperspectral imaging is limited by the push-broom imaging method, and the multi-angle information is often difficult to obtain. In addition, the random variation of solar illumination during UAV low-altitude flight makes the irradiance between different push-broom hyperspectral rows and different airstrips inconsistent, which significantly affects the radiometric consistency of BRDF modeling and results in the difficulty of accurately portraying the three-dimensional spatial reflectance distribution in the UAV model. These problems largely impede the application of outdoor BRDF. Based on this, this paper proposes a fast multi-angle information acquisition scheme with a high-accuracy BRDF modeling method considering illumination variations, which mainly involves a lightweight system for BRDF acquisition and three improved BRDF models considering illumination corrections. We adopt multi-rectangular nested flight paths for multi-gray level targets, use multi-mode equipment to acquire spatial illumination changes and multi-angle reflectivity information in real-time, and introduce the illumination correction factor K through data coupling to improve the kernel, Hapke, and RPV models, and, overall, the accuracy of the improved model is increased by 20.83%, 11.11%, and 31.48%, respectively. The results show that our proposed method can acquire multi-angle information quickly and accurately using push-broom hyperspectral imaging, and the improved model eliminates the negative effect of illumination on BRDF modeling. This work is vital for expanding the multi-angle information acquisition pathway and high-efficiency and high-precision outdoor BRDF modeling.
- 31 January 2024
- Published by MDPI AG in Remote Sensing
- Vol. 16 (3) , 543
Open AccessMethodology and Modeling of UAV Push-Broom Hyperspectral BRDF Observation Considering Illumination Correction
The Bidirectional Reflectance Distribution Function (BRDF) is a critical spatial distribution parameter in the quantitative research of remote sensing and has a wide range of applications in radiometric correction, elemental inversion, and surface feature estimation. As a new means of BRDF modeling, UAV push-broom hyperspectral imaging is limited by the push-broom imaging method, and the multi-angle information is often difficult to obtain. In addition, the random variation of solar illumination during UAV low-altitude flight makes the irradiance between different push-broom hyperspectral rows and different airstrips inconsistent, which significantly affects the radiometric consistency of BRDF modeling and results in the difficulty of accurately portraying the three-dimensional spatial reflectance distribution in the UAV model. These problems largely impede the application of outdoor BRDF. Based on this, this paper proposes a fast multi-angle information acquisition scheme with a high-accuracy BRDF modeling method considering illumination variations, which mainly involves a lightweight system for BRDF acquisition and three improved BRDF models considering illumination corrections. We adopt multi-rectangular nested flight paths for multi-gray level targets, use multi-mode equipment to acquire spatial illumination changes and multi-angle reflectivity information in real-time, and introduce the illumination correction factor K through data coupling to improve the kernel, Hapke, and RPV models, and, overall, the accuracy of the improved model is increased by 20.83%, 11.11%, and 31.48%, respectively. The results show that our proposed method can acquire multi-angle information quickly and accurately using push-broom hyperspectral imaging, and the improved model eliminates the negative effect of illumination on BRDF modeling. This work is vital for expanding the multi-angle information acquisition pathway and high-efficiency and high-precision outdoor BRDF modeling.
- Open Access
- 31 December 2023
- Published by MDPI AG in Remote Sensing
- Vol. 16 (1) , 180
Attention Network with Outdoor Illumination Variation Prior for Spectral Reconstruction from RGB Images
Hyperspectral images (HSIs) are widely used to identify and characterize objects in scenes of interest, but they are associated with high acquisition costs and low spatial resolutions. With the development of deep learning, HSI reconstruction from low-cost and high-spatial-resolution RGB images has attracted widespread attention. It is an inexpensive way to obtain HSIs via the spectral reconstruction (SR) of RGB data. However, due to a lack of consideration of outdoor solar illumination variation in existing reconstruction methods, the accuracy of outdoor SR remains limited. In this paper, we present an attention neural network based on an adaptive weighted attention network (AWAN), which considers outdoor solar illumination variation by prior illumination information being introduced into the network through a basic 2D block. To verify our network, we conduct experiments on our Variational Illumination Hyperspectral (VIHS) dataset, which is composed of natural HSIs and corresponding RGB and illumination data. The raw HSIs are taken on a portable HS camera, and RGB images are resampled directly from the corresponding HSIs, which are not affected by illumination under CIE-1964 Standard Illuminant. Illumination data are acquired with an outdoor illumination measuring device (IMD). Compared to other methods and the reconstructed results not considering solar illumination variation, our reconstruction results have higher accuracy and perform well in similarity evaluations and classifications using supervised and unsupervised methods.
- 31 December 2023
- Published by MDPI AG in Remote Sensing
- Vol. 16 (1) , 180
Open AccessAttention Network with Outdoor Illumination Variation Prior for Spectral Reconstruction from RGB Images
Hyperspectral images (HSIs) are widely used to identify and characterize objects in scenes of interest, but they are associated with high acquisition costs and low spatial resolutions. With the development of deep learning, HSI reconstruction from low-cost and high-spatial-resolution RGB images has attracted widespread attention. It is an inexpensive way to obtain HSIs via the spectral reconstruction (SR) of RGB data. However, due to a lack of consideration of outdoor solar illumination variation in existing reconstruction methods, the accuracy of outdoor SR remains limited. In this paper, we present an attention neural network based on an adaptive weighted attention network (AWAN), which considers outdoor solar illumination variation by prior illumination information being introduced into the network through a basic 2D block. To verify our network, we conduct experiments on our Variational Illumination Hyperspectral (VIHS) dataset, which is composed of natural HSIs and corresponding RGB and illumination data. The raw HSIs are taken on a portable HS camera, and RGB images are resampled directly from the corresponding HSIs, which are not affected by illumination under CIE-1964 Standard Illuminant. Illumination data are acquired with an outdoor illumination measuring device (IMD). Compared to other methods and the reconstructed results not considering solar illumination variation, our reconstruction results have higher accuracy and perform well in similarity evaluations and classifications using supervised and unsupervised methods.
- Open Access
- 8 September 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4430
Multi-Prior Graph Autoencoder with Ranking-Based Band Selection for Hyperspectral Anomaly Detection
Hyperspectral anomaly detection (HAD) is an important technique used to identify objects with spectral irregularity that can contribute to object-based image analysis. Latterly, significant attention has been given to HAD methods based on Autoencoders (AE). Nevertheless, due to a lack of prior information, transferring of modeling capacity, and the “curse of dimensionality”, AE-based detectors still have limited performance. To address the drawbacks, we propose a Multi-Prior Graph Autoencoder (MPGAE) with ranking-based band selection for HAD. There are three main components: the ranking-based band selection component, the adaptive salient weight component, and the graph autoencoder. First, the ranking-based band selection component removes redundant spectral channels by ranking the bands by employing piecewise-smooth first. Then, the adaptive salient weight component adjusts the reconstruction ability of the AE based on the salient prior, by calculating spectral-spatial features of the local context and the multivariate normal distribution of backgrounds. Finally, to preserve the geometric structure in the latent space, the graph autoencoder detects anomalies by obtaining reconstruction errors with a superpixel segmentation-based graph regularization. In particular, the loss function utilizes and adaptive salient weight to enhance the capacity of modeling anomaly patterns. Experimental results demonstrate that the proposed MPGAE effectively outperforms other state-of-the-art HAD detectors.- 8 September 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4430
Open AccessMulti-Prior Graph Autoencoder with Ranking-Based Band Selection for Hyperspectral Anomaly Detection
Hyperspectral anomaly detection (HAD) is an important technique used to identify objects with spectral irregularity that can contribute to object-based image analysis. Latterly, significant attention has been given to HAD methods based on Autoencoders (AE). Nevertheless, due to a lack of prior information, transferring of modeling capacity, and the “curse of dimensionality”, AE-based detectors still have limited performance. To address the drawbacks, we propose a Multi-Prior Graph Autoencoder (MPGAE) with ranking-based band selection for HAD. There are three main components: the ranking-based band selection component, the adaptive salient weight component, and the graph autoencoder. First, the ranking-based band selection component removes redundant spectral channels by ranking the bands by employing piecewise-smooth first. Then, the adaptive salient weight component adjusts the reconstruction ability of the AE based on the salient prior, by calculating spectral-spatial features of the local context and the multivariate normal distribution of backgrounds. Finally, to preserve the geometric structure in the latent space, the graph autoencoder detects anomalies by obtaining reconstruction errors with a superpixel segmentation-based graph regularization. In particular, the loss function utilizes and adaptive salient weight to enhance the capacity of modeling anomaly patterns. Experimental results demonstrate that the proposed MPGAE effectively outperforms other state-of-the-art HAD detectors. - Open Access
- 31 March 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (7) , 1868
Unsupervised Transformer Boundary Autoencoder Network for Hyperspectral Image Change Detection
In the field of remote sens., change detection is an important monitoring technology. However, effectively extracting the change feature is still a challenge, especially with an unsupervised method. To solve this problem, we proposed an unsupervised transformer boundary autoencoder network (UTBANet) in this paper. UTBANet consists of a transformer structure and spectral attention in the encoder part. In addition to reconstructing hyperspectral images, UTBANet also adds a decoder branch for reconstructing edge information. The designed encoder module is used to extract features. First, the transformer structure is used for extracting the global features. Then, spectral attention can find important feature maps and reduce feature redundancy. Furthermore, UTBANet reconstructs the hyperspectral image and boundary information simultaneously through two decoders, which can improve the ability of the encoder to extract edge features. Our experiments demonstrate that the proposed structure significantly improves the performance of change detection. Moreover, comparative experiments show that our method is superior to most existing unsupervised methods.
- 31 March 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (7) , 1868
Open AccessUnsupervised Transformer Boundary Autoencoder Network for Hyperspectral Image Change Detection
In the field of remote sens., change detection is an important monitoring technology. However, effectively extracting the change feature is still a challenge, especially with an unsupervised method. To solve this problem, we proposed an unsupervised transformer boundary autoencoder network (UTBANet) in this paper. UTBANet consists of a transformer structure and spectral attention in the encoder part. In addition to reconstructing hyperspectral images, UTBANet also adds a decoder branch for reconstructing edge information. The designed encoder module is used to extract features. First, the transformer structure is used for extracting the global features. Then, spectral attention can find important feature maps and reduce feature redundancy. Furthermore, UTBANet reconstructs the hyperspectral image and boundary information simultaneously through two decoders, which can improve the ability of the encoder to extract edge features. Our experiments demonstrate that the proposed structure significantly improves the performance of change detection. Moreover, comparative experiments show that our method is superior to most existing unsupervised methods.
- Open Access
Joint Texture Search and Histogram Redistribution for Hyperspectral Image Quality Improvement
Due to optical noise, electrical noise, and compression error, data hyperspectral remote sensing equipment is inevitably contaminated by various noises, which seriously affect the applications of hyperspectral data. Therefore, it is of great significance to enhance hyperspectral imaging data quality. To guarantee the spectral accuracy during data processing, band-wise algorithms are not suitable for hyperspectral data. This paper proposes a quality enhancement algorithm based on texture search and histogram redistribution combined with denoising and contrast enhancement. Firstly, a texture-based search algorithm is proposed to improve the accuracy of denoising by improving the sparsity of 4D block matching clustering. Then, histogram redistribution and Poisson fusion are used to enhance spatial contrast while preserving spectral information. Synthesized noising data from public hyperspectral datasets are used to quantitatively evaluate the proposed algorithm, and multiple criteria are used to analyze the experimental results. At the same time, classification tasks were used to verify the quality of the enhanced data. The results show that the proposed algorithm is satisfactory for hyperspectral data quality improvement.
Open AccessJoint Texture Search and Histogram Redistribution for Hyperspectral Image Quality Improvement
Due to optical noise, electrical noise, and compression error, data hyperspectral remote sensing equipment is inevitably contaminated by various noises, which seriously affect the applications of hyperspectral data. Therefore, it is of great significance to enhance hyperspectral imaging data quality. To guarantee the spectral accuracy during data processing, band-wise algorithms are not suitable for hyperspectral data. This paper proposes a quality enhancement algorithm based on texture search and histogram redistribution combined with denoising and contrast enhancement. Firstly, a texture-based search algorithm is proposed to improve the accuracy of denoising by improving the sparsity of 4D block matching clustering. Then, histogram redistribution and Poisson fusion are used to enhance spatial contrast while preserving spectral information. Synthesized noising data from public hyperspectral datasets are used to quantitatively evaluate the proposed algorithm, and multiple criteria are used to analyze the experimental results. At the same time, classification tasks were used to verify the quality of the enhanced data. The results show that the proposed algorithm is satisfactory for hyperspectral data quality improvement.