Deep Seasonal Network for Remote Sensing Imagery Classification of Multi-Temporal Sentinel-2 Data
Open Access
- 26 September 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (19) , 4705
Abstract
As a medium-resolution multi-temporal data source, Sentinel-2 data has the potential to match the performance of using very-high-resolution (VHR) images in deep learning applications. To fully leverage the multi-temporal nature of Sentinel-2 data, we introduce the Deep Seasonal Network (DeepSN). This composite architecture combines a pre-trained deep convolutional neural network (DCNN) for visual feature extraction with a long short-term memory (LSTM) model to capture temporal information and make classification predictions. We evaluate the effectiveness of DeepSN on a Maasai Boma classification task in the Tanzania region. The DeepSN takes a sequence of four seasonal data, each spanning three months, for Boma prediction. Through cross-season validation experiments, we compare various advanced DCNNs and select EfficientNet as the backbone for DeepSN, as it performs the best. DeepSN with an EfficientNet backbone achieves a significant 19% improvement in the F1 score compared to plain EfficientNet for the Boma classification task. This work introduces a versatile composite architecture capable of handling multi-temporal data efficiently, providing flexibility in choosing the most suitable feature extraction backbone. The performance of DeepSN demonstrates the viability of utilizing medium-resolution multi-temporal data instead of high-resolution images for diverse tasks.Keywords
This publication has 35 references indexed in Scilit:
- End-to-End Airplane Detection Using Transfer Learning in Remote Sensing ImagesRemote Sensing, 2018
- Fusion of Deep Convolutional Neural Networks for Land Cover Classification of High-Resolution ImageryIEEE Geoscience and Remote Sensing Letters, 2017
- Densely Connected Convolutional Networks2017
- Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution ImageryIEEE Geoscience and Remote Sensing Letters, 2017
- LSTM: A Search Space OdysseyIEEE Transactions on Neural Networks and Learning Systems, 2016
- Deep Residual Learning for Image Recognition2016
- Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing ImageryRemote Sensing, 2015
- Going deeper with convolutions2015
- From Feedforward to Recurrent LSTM Neural Networks for Language ModelingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Ethnicity and Child Health in Northern Tanzania: Maasai Pastoralists Are Disadvantaged Compared to Neighbouring Ethnic GroupsPLOS ONE, 2014