Open Access
- 26 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 14 (19391404) , 9038-9063
Abstract
Bringing together a number of cutting-edge technologies that range from storing extremely large volumes of data all the way to developing scalable machine learning and deep learning algorithms in a distributed manner and having them operate over the same infrastructure poses unprecedented challenges. One of these challenges is the integration of European Space Agency (ESA)'s Thematic Exploitation Platforms (TEPs) and data information access service platforms with a data platform, namely Hopsworks, which enables scalable data processing, machine learning, and deep learning on Copernicus data, and development of very large training datasets for deep learning architectures targeting the classification of Sentinel images. In this article, we present the software architecture of ExtremeEarth that aims at the development of scalable deep learning and geospatial analytics techniques for processing and analyzing petabytes of Copernicus data. The ExtremeEarth software infrastructure seamlessly integrates existing and novel software platforms and tools for storing, accessing, processing, analyzing, and visualizing large amounts of Copernicus data. New techniques in the areas of remote sensing and artificial intelligence with an emphasis on deep learning are developed. These techniques and corresponding software presented in this article are to be integrated with and used in two ESA TEPs, namely Polar and Food Security TEPs. Furthermore, we present the integration of Hopsworks with the Polar and Food Security use cases and the flow of events for the products offered through the TEPs.Keywords
Funding Information
- European Union's Horizon 2020 research and innovation programme
This publication has 32 references indexed in Scilit:
- MULTI-TEMPORAL LAND COVER CLASSIFICATION WITH LONG SHORT-TERM MEMORY NEURAL NETWORKSThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2017
- Apache Parquet2016
- Rethinking the Inception Architecture for Computer Vision2016
- Sea Ice Concentration Estimation During Melt From Dual-Pol SAR Scenes Using Deep Convolutional Neural Networks: A Case StudyIEEE Transactions on Geoscience and Remote Sensing, 2016
- Late-summer sea ice segmentation with multi-polarisation SAR features in C and X bandThe Cryosphere, 2016
- SemaGrow2015
- Comparison of feature based segmentation of full polarimetric SAR satellite sea ice images with manually drawn ice chartsThe Cryosphere, 2013
- Microwave Remote Sensing2013
- Long Short-Term Memory2012
- Classification of imbalanced remote-sensing data by neural networksPattern Recognition Letters, 1997