Object-Level Hybrid Spatiotemporal Fusion: Reaching a Better Tradeoff Among Spectral Accuracy, Spatial Accuracy, and Efficiency
Open Access
- 30 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 16 (19391404) , 8007-8021
Abstract
Spatiotemporal fusion (STF) is a cost-effective way to complement the spatiotemporal resolution of multi-source images, which has been employed in various applications requiring image sequences. In real-world applications, the spectral accuracy, spatial accuracy and efficiency of STF play a critical role. Despite this, most STF methods focus on improving the spectral accuracy, while the challenges of spatial information loss and low efficiency have received limited attention. Additionally, the improvements of spectral accuracy, spatial accuracy and efficiency in STF are contradictory, and existing STF methods cannot balance them well, which limits their reliability and applicability for various STF tasks. To solve above issues, this study proposes an object-level hybrid spatiotemporal fusion method (OL-HSTFM), which incorporates the efficiency advantage of object-level fusion strategy, spectral accuracy advantage of the three-step method (Fit-FC), and the spatial accuracy advantage of the spatial and temporal adaptive reflectance fusion model (STARFM). The performance of OL-HSTFM was compared with two classic STF methods and eight state-of-the-art STF methods at two sites. The experimental results indicate that OL-HSTFM outperforms the other 10 methods in overall performance and has excellent efficiency. Furthermore, this study proposes a new metric that can assess the accuracy of both spatial and spectral domains in STF, which provides a more comprehensively and intuitively measurement of the quality of fused images compared to commonly used metrics. The program of OL-HSTFM is openly available on https://github.com/Andy-cumt/Object-level-spatiotemporal-fusion-models .Keywords
Funding Information
- Otto Poon Charitable Foundation Smart Cities Research Institute
- Hong Kong Polytechnic University (CD03)
- Urban Informatics for Smart Cities
- Hong Kong Polytechnic University (1-ZVN6)
This publication has 53 references indexed in Scilit:
- A flexible spatiotemporal method for fusing satellite images with different resolutionsRemote Sensing of Environment, 2016
- Comparison of Spatiotemporal Fusion Models: A ReviewRemote Sensing, 2015
- A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusionRemote Sensing of Environment, 2015
- Spatio-temporal reflectance fusion via unmixing: accounting for both phenological and land-cover changesInternational Journal of Remote Sensing, 2014
- Blending MODIS and Landsat images for urban flood mappingInternational Journal of Remote Sensing, 2014
- Assessing the accuracy of blending Landsat–MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: A framework for algorithm selectionRemote Sensing of Environment, 2013
- A spatial and temporal reflectance fusion model considering sensor observation differencesInternational Journal of Remote Sensing, 2013
- An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regionsRemote Sensing of Environment, 2010
- Unmixing-based multisensor multiresolution image fusionIEEE Transactions on Geoscience and Remote Sensing, 1999
- Linear mixing and the estimation of ground cover proportionsInternational Journal of Remote Sensing, 1993