Lossy Compression of Integer Astronomical Images Preserving Photometric Properties*
Open Access
- 1 November 2024
- journal article
- research article
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 136 (11) , 114506
Abstract
Observatories are producing astronomical image data at quickly increasing rates. As a result, the efficiency of the compression methods employed is critical to meet the storage and distribution requirements of both observatories and scientists. This paper presents a novel lossy compression technique that is able to preserve the results of photometry analysis with high fidelity while improving upon the state of the art in terms of compression performance. The proposed compression pipeline combines a flexible bi-region quantization scheme with the lossless, dictionary-based, LPAQ9M encoder. The quantization process allows compression performance and photometric fidelity to be precisely tailored to different scientific requirements. A representative data set of 16-bit integer astronomical images produced by telescopes from all around the world has been employed to empirically assess its compression-fidelity trade-offs, and compare them to those of the de facto standard Fpack compressor. In these experiments, the widespread SExtractor software is employed as the ground truth for photometric analysis. Results indicate that after lossy compression with our proposed method, the decompressed data allows consistent detection of over 99% of all astronomical objects for all tested telescopes, maintaining the highest photometric fidelity (as compared to state of the art lossy techniques). When compared to the best configuration of Fpack (Hcompress lossy using 1 quantization parameter) at similar compression rates, our proposed method provides better photometry precision: 7.15% more objects are detected with magnitude errors below 0.01, and 9.13% more objects with magnitudes below SExtractor’s estimated measurement error. Compared to the best lossless compression results, the proposed pipeline allows us to reduce the compressed data set volume by up to 38.75% and 27.94% while maintaining 90% and 95%, respectively, of the detected objects with magnitude differences lower than 0.01 mag; and up to 18.93% while maintaining 90% of the detected objects with magnitude differences lower than the photometric measure error.Keywords
Funding Information
- European Regional Development Fund (PID2021-125258OB-I00)
- Photsat project by the Institute of Space Studies of Catalonia
- Departament d'Innovació, Universitats i Empresa, Generalitat de Catalunya (SGR2021-00643)
This publication has 16 references indexed in Scilit:
- Spartan Infrared Camera, a High-Resolution Imager for the SOAR Telescope: Design, Tests, and On-Telescope PerformancePublications of the Astronomical Society of the Pacific, 2012
- On the Absolute Age of the Globular Cluster M921Publications of the Astronomical Society of the Pacific, 2010
- Optimal Compression of Floating-Point Astronomical Images Without Significant Loss of InformationPublications of the Astronomical Society of the Pacific, 2010
- On the Stellar Content of the Carina Dwarf Spheroidal Galaxy1Publications of the Astronomical Society of the Pacific, 2010
- Achieving continuity: a story of stellar magnitudeStudies in History and Philosophy of Science, 2010
- Near-Infrared Monitoring of Ultracool Dwarfs: Prospects for Searching for Transiting CompanionsPublications of the Astronomical Society of the Pacific, 2008
- Millimagnitude‐Precision Photometry of Bright Stars with a 1 m Telescope and a Standard CCDPublications of the Astronomical Society of the Pacific, 2006
- PHOTZIP: A Lossy FITS Image Compression Algorithm That Protects User-defined Levels of Photometric IntegrityThe Astronomical Journal, 2005
- Definition of the Flexible Image Transport System (FITS)Astronomy & Astrophysics, 2001
- SExtractor: Software for source extractionAstronomy and Astrophysics Supplement Series, 1996