Semantic Image Encoding and Communication for Earth Observation With LEO Satellites
- 29 August 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (2) , 1210-1224
Abstract
The substantial volume of data generated by Earth observation (EO) satellites poses a significant challenge to the limited-rate satellite-to-ground links. This paper addresses the downlink communication problem of change detection in multi-spectral satellite images for EO purposes. The proposed method is based on a cohesive strategy capable of eliminating clouds and performing semantic encoding during image processing. This approach is a manifestation of semantic communication, as it encodes vital information for the target application, in the form of changed multi-spectral pixels (MPs) to minimize energy consumption. The proposed method is based on a three-stage end-to-end scoring mechanism, which quantifies the significance of each MP before determining its transmission. Specifically, the sensing image is (1) normalized and passed through a high-performance cloud filtering via the Cloud-SLR model, (2) passed to the proposed scoring algorithm that uses Change-Net to identify MPs that have a high likelihood of being changed, compress them, and forward to the ground station, and (3) reconstructed at ground gateway based on the reference image and received data. The numerical results show the effectiveness of the proposed framework in achieving energy savings of up to 58% while upholding the transmission of high-quality data for satellite-based EO applications.Keywords
All Related Versions
Funding Information
- Villum Investigator Grant “WATER” from the Velux Foundation, Denmark
- Luxembourg National Research Fund (FNR) under the project SmartSpace (C21/IS/16193290)
This publication has 54 references indexed in Scilit:
- Fully Transformer Network for Change Detection of Remote Sensing Images2023
- TINYCD: a (not so) deep learning model for change detectionNeural Computing and Applications, 2022
- GLF-CR: SAR-enhanced cloud removal with global–local fusionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Multitask learning for large-scale semantic change detectionComputer Vision and Image Understanding, 2019
- Remote Sensing, natural hazards and the contribution of ESA Sentinels missionsRemote Sensing Applications: Society and Environment, 2017
- Robust Change Vector Analysis (RCVA) for multi-sensor very high resolution optical satellite dataInternational Journal of Applied Earth Observation and Geoinformation, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 imagesRemote Sensing of Environment, 2015
- Object-based cloud and cloud shadow detection in Landsat imageryRemote Sensing of Environment, 2012
- An assessment of several linear change detection techniques for mapping forest mortality using multitemporal landsat TM dataRemote Sensing of Environment, 1996