Spatiotemporal Fusion for Nighttime Light Remote Sensing Images With Multivariate Activation Function
- 16 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Abstract
Nighttime light (NTL) remote sensing images record various light information. However, it is often difficult for NTL remote sensing images to have both high temporal and high spatial resolution. To solve the above problem, this letter proposes a spatiotemporal fusion model for NTL images. Based on the convolutional neural network (CNN), we designed a new multivariate activation function and introduced adaptive instance normalization (AdaIN) to improve the quality of image fusion. Specifically, this multivariate activation function captures the abrupt changes from reference time to target time, removes redundant information, and retains complementary information. Meanwhile, the AdaIN effectively reduces the systematic errors caused by different sensors. To verify the effectiveness of the model, this letter uses Luojia1-01 and VNP46A1 remote sensing images to construct an NTL remote sensing dataset for fusion and carry out comparative experiments and ablation experiments. The results show that our method has a better performance.Keywords
Funding Information
- National Natural Science Foundation of China (41971397)
This publication has 13 references indexed in Scilit:
- An Enhanced Deep Convolutional Model for Spatiotemporal Image FusionRemote Sensing, 2019
- Assessing the Ability of Luojia 1-01 Imagery to Detect Feeble Nighttime LightsSensors, 2019
- Applications of Satellite Remote Sensing of Nighttime Light Observations: Advances, Challenges, and PerspectivesRemote Sensing, 2019
- Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization2017
- VIIRS night-time lightsInternational Journal of Remote Sensing, 2017
- A flexible spatiotemporal method for fusing satellite images with different resolutionsRemote Sensing of Environment, 2016
- Deep learningNature, 2015
- A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusionRemote Sensing of Environment, 2015
- Spatiotemporal Reflectance Fusion via Sparse RepresentationIEEE Transactions on Geoscience and Remote Sensing, 2012
- On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectanceIEEE Transactions on Geoscience and Remote Sensing, 2006