Neural-based Compression Scheme for Solar Image Data
Authors:
- Atefeh KhoshkhahtinatAKAtefeh Khoshkhahtinat
- Jeremy A. GrajedaJGJeremy A. Grajeda
- Piyush M. MehtaPMPiyush M. Mehta
- Nasser M. NasrabadiNNNasser M. Nasrabadi
- Laura E. BoucheronLBLaura E. Boucheron
- Barbara J. ThompsonBTBarbara J. Thompson
- Michael S. F. KirkMKMichael S. F. Kirk
- Daniel da SilvaDSDaniel da Silva
Preprint
Abstract
Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data. On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression. In this work, we propose a neural network-based lossy compression method to be used in NASA's data-intensive imagery missions. We chose NASA's SDO mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm. In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs. The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective. Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data. As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of $\sim0.1$ bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.
Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Quantifying the Consistency and Characterizing the Confidence of Coronal Holes Detected by Active Contours Without Edges (ACWE)Solar Physics, 2023
- A review and meta-analysis of Generative Adversarial Networks and their applications in remote sensingInternational Journal of Applied Earth Observation and Geoinformation, 2022
- The SPoCA-suite: Software for extraction, characterization, and tracking of active regions and coronal holes on EUV imagesAstronomy & Astrophysics, 2013
- Stream structure and coronal sources of the solar wind during the May 12th, 1997 CMEJournal of Atmospheric and Solar-Terrestrial Physics, 2004
- Improved Method for Specifying Solar Wind Speed Near the SunAIP Conference Proceedings, 2003
- JPEG2000 Image Compression Fundamentals, Standards and Practice2002
- Vector Quantization and Signal Compression1992
- Solar wind speed and coronal flux-tube expansionThe Astrophysical Journal, 1990
- Coronal holesSolar Physics, 1972
- Properties of a Coronal "hole" Derived from Extreme-Ultraviolet ObservationsThe Astrophysical Journal, 1972