Yinhui Tang

Fourier-transform imaging spectroscopy (FTIS) faces inherent limitations in spectral resolution due to the maximum optical path difference (OPD) achievable by its interferometer. To overcome this constraint, we propose a novel spectral super-resolution technology integrating a Fabry–Pérot interferometer (FPI) with FTIS, termed multi-component joint interferometric hyperspectral imaging (MJI-HI). This method leverages the FPI to periodically modulate the target spectrum, enabling FTIS to capture a modulated interferogram. By encoding high-frequency spectral interference information into low-frequency interference regions through FPI modulation, an advanced inversion algorithm is developed to reconstruct the encoded high-frequency components, thereby achieving spectral super-resolution. This study analyzes the impact of primary optical errors and tolerance thresholds in the FPI and FTIS on the interferograms and spectral fidelity of MJI-HI, along with proposing algorithmic improvements. Notably, certain errors in the FTIS and FPI exhibit mutual interference. The theoretical framework for error analysis is validated and discussed through numerical simulations, providing critical theoretical support for subsequent instrument development and laying a foundation for advancing novel spectral super-resolution technologies.

A new spectral super-resolution technique was proposed by combining the Fabry–Perot interferometer (FPI) with Temporally and Spatially Modulated Fourier Transform Imaging Spectrometer (TSMFTIS). This study uses the multi-beam interference of the FPI to modulate the target spectrum periodically, and it acquires the modulated interferogram through TSMFTIS. The combined interference of the two techniques overcomes the limitations of the maximum optical path difference (OPD) on spectral resolution. FPI is used to encode high-frequency interference information into low-frequency interference information, proposing an inversion algorithm to recover high-frequency information, studying the impact of FPI optical defects on the system, and proposing targeted improvement algorithms. The simulation results indicate that this method can achieve multi-component joint interference imaging, improving spectral resolution by twofold. This technology offers advantages such as high throughput, stability, simple and compact structure, straightforward principles, high robustness, and low cost. It provides new insights into TSMFTIS spectral super-resolution research.

In Bandpass Sampling Fourier Transform Spectroscopy, a comprehensive method for evaluating signal-to-noise ratio (SNR) has not yet been established. This paper employs an energy conservation approach to analyze the relationship of SNR between interferogram and spectra in Bandpass Sampling Time-Modulated Fourier Transform Spectroscopy (BPS-FTS). It systematically presents models for the average SNR of the system interferogram and the average SNR of reconstructed spectra under different parameters. These models are compared with SNR models in traditional Fourier transform spectroscopy (FTS) and are mutually validated through theoretical modeling and simulation analysis. It provides a theoretical basis and simulation verification for the design and implementation of the system.

For traditional Fourier transform (FTS), its integral sampling usually meets the Spectral Modulation Transfer Function (SMTF) criterion. However, for bandpass-sampling Fourier transform spectroscopy (BPS-FTS), based on our analysis, the integral sampling condition derived from the Spectral Modulation Transfer Function (SMTF) is excessively stringent. In other words, the interval of the integral sampling time that fulfills the tolerance requirements for the reconstructed spectrum is very narrow. There are numerous integration sampling time intervals outside this range that still meet the tolerance requirements for the reconstructed spectrum. In this paper, through theoretical modeling, we propose a method based on average |SMTF| as the selection criterion for the integration sampling time. Through simulation analysis, it is evident that the intervals and range of the integral sampling time obtained via this method are more accurate, ensuring the tolerance requirements of the reconstructed spectrum. Under these intervals, when conducting integral sampling on the interferogram, the spectral deviation of the reconstructed spectrum is minimal, and the Spectral Correlation Mapper (SCM) is nearly equal to one. This indicates that compared with the SMTF criterion in traditional FTS, this method is more suitable for the characteristics of BPS-FTS. The analysis in this paper can provide theoretical and simulation support for the implementation of BPS-FTS.

Raman spectroscopy has been widely applied in numerous fields including bioanalysis, disease diagnosis, and molecular recognition, owing to its unique advantages of being non-invasive, rapid, and highly specific. However, the acquisition of Raman spectral data is often susceptible to various noise interferences, such as shot noise from the internal detector and dark current noise from the instrument. As a result, the weak Raman signals typically become arduous to discern, which affects the localization and identification of characteristic spectral peaks. This study investigates variational mode decomposition (VMD), empirical wavelet transform (EWT), and integrated encoder-bidirectional long short-term memory (EBiLSTM) modules to propose a neural network algorithm for adaptive denoising of Raman spectra. By combining VMD and EWT, the Raman spectra are decomposed into several sub-sequences, which solves the problem of mode mixing between high-frequency signals and noise in empirical mode decomposition, and significantly reduces the complexity of the original Raman spectral lines. The correlation coefficient between each modal component and the original signal is calculated along with the zero-crossing rate index to categorize the noise and signal sequences. Leveraging the linear differences between the ideal spectral lines and the noisy spectral curves, an encoder-bidirectional long short-term memory (EBiLSTM) denoising network is constructed for hierarchical denoising to extract valid spectral feature information from the high-frequency components, realizing refined adaptive denoising of the Raman spectra. Industry standard objective evaluation metrics on the signal-to-noise ratio and root mean square error are utilized to conduct simulation experiments comparing state-of-the-art algorithms, including empirical mode decomposition, VMD, sliding window averaging, and wavelet thresholding. The experimental results demonstrate that the Raman spectral denoising algorithm combining variational mode decomposition and neural networks improves the denoising performance by 13.38% to 72%, exhibiting higher accuracy and reliability.

Single-lens imaging systems can capture spectral information, but they are affected by aberrations, defocusing, and other factors, leading to spectral data overlap. It is then necessary to perform restoration on overlapped spectral data. The restoration method should not only deblur image information, but also recover spectral information for each wavelength band. In other words, the restoration process needs to handle both spatial and spectral information in parallel while ensuring that neither is distorted. In this study, while considering the characteristics of capturing overlapped information in a single-lens imaging system, a spectrum restoration method based on gradient prior information optimization is proposed. This method is shown to achieve high-quality restoration of both images and spectra. The feasibility of this algorithm is demonstrated through simulation and experimental verification, which show that the restoration quality of spectra using the proposed algorithm is improved compared to that achieved using the MTV algorithm.

A rich and effective dataset is an important foundation for the development of AI algorithms, and the quantity and quality of the dataset determine the upper limit level of the algorithms. For aerospace remote sensing datasets, due to the high cost of data collection and susceptibility to meteorological and airway conditions, the existing datasets have two problems: firstly, the number of datasets is obviously insufficient, and, secondly, there is large unevenness between different categories in datasets. One of the effective solutions is to use neural networks to generate fake data by learning from real data, but existing methods still find difficulty in generating remote sensing sample images with good texture detail and geometric distortion. To address the shortcomings of existing image generation algorithms, this paper proposes a gradient structure information-guided attention generative adversarial network (SGA-GAN) for remote sensing image generation, which contains two innovative initiatives: on the one hand, a learnable gradient structure information extraction branch network can be added to the generator network to obtain complex structural information in the sample image, thus alleviating the distortion of the sample geometric structure in remote sensing image generation; on the other hand, a multidimensional self-attention feature selection module is proposed to further improve the quality of the generated remote sensing images by connecting cross-attentive modules as well as spatial and channel attention modules in series to guide the generator to better utilize global information. The algorithm proposed in this paper outperformed other methods, such as StyleGAN-XL and FastGAN, in both the qualitative and quantitative evaluation, whereby the FID on the DOTA dataset decreased by 23.927 and the IS was improved by 2.351. The comparison experiments show that the method proposed in this paper can generate more realistic sample images, and images generated by this method can improve object detection metrics by increasing the number of single-category datasets and the number of targets in fewer categories in multi-category datasets, which means it can be effectively used in the field of intelligent processing of remote sensing images.

We propose a new spectral super-resolution technique combined with a Fabry–Perot interferometer (FPI) and an interferometric hyperspectral imager. To overcome the limitation of the maximal optical path difference (OPD) on the spectral resolution, the object spectrum is periodically modulated based on the FPI, and an optical Fourier transform of the modulated spectrum information is performed using a double-beam interferometer to obtain an interferogram. Drawing on the concept of nonlinear structured light microscopy, the displacement of the high-frequency interference information in the interferogram after adding the FPI is analyzed to restore the high-frequency interference information and improve the spectral resolution. The optical system has a compact structure with little impact on complexity, spectral range, or luminous flux. Our simulation results show that this method can realize multicomponent joint-interference imaging to obtain spectral super-resolution information. The effects of the FPI’s reflectance and interval are analyzed, and the reflectance needs to be within 20~80% and the interval must be as close as possible to the maximum optical range of the interferometer. Compared with previous, related innovations, this innovation has the advantages of higher system stability, higher data utilization, and better suitability for interferometric imaging spectrometers.

Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have better generalizability. However, the existing deep learning algorithms usually suffer from feature misalignment, resulting in a high probability of missing details or errors in the recovered images. This paper proposes an end-to-end generative adversarial network (SDD-GAN) for single-image motion deblurring to address this problem and to optimize the recovery of blurred remote sensing images. Firstly, this paper applies a feature alignment module (FAFM) in the generator to learn the offset between feature maps to adjust the position of each sample in the convolution kernel and to align the feature maps according to the context; secondly, a feature importance selection module is introduced in the generator to adaptively filter the feature maps in the spatial and channel domains, preserving reliable details in the feature maps and improving the performance of the algorithm. In addition, this paper constructs a self-constructed remote sensing dataset (RSDATA) based on the mechanism of image blurring caused by the high-speed orbital motion of satellites. Comparative experiments are conducted on self-built remote sensing datasets and public datasets as well as on real remote sensing blurred images taken by an in-orbit satellite (CX-6(02)). The results show that the algorithm in this paper outperforms the comparison algorithm in terms of both quantitative evaluation and visual effects.

Fourier transform spectroscopy with bandpass sampling (BPS-FTS) increases the interferogram sampling step and reduces sampling frequency, thereby reducing system implementation difficulty. However, this technology has only been introduced in principle and lacks analysis of the actual system error. In this paper, we present a theoretical analysis of the optical system diffraction effect, derive the bandpass spectrum bandwidth and interferogram sampling step under the influence of the diffraction effect, and conduct modeling and a simulation analysis with and without the diffraction effect. Through simulation, we found that when the diffraction effect was considered, the relative deviation of the recovered spectrum from the input spectrum was 1.30%, and the spectral similarity was 0.9669. However, without considering the diffraction effect, the relative deviation of the recovered spectrum from the input spectrum was 6.23%, and the spectral similarity was only −0.0056. The simulation results demonstrate that the diffraction effect has a significant influence on BPS-FTS interferogram sampling and recovery spectra. The results of this study have reference significance for their technical realization of BPS-FTS.