Joan Bartrina-Rapesta
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Joan Bartrina-Rapesta has a total of 65 co-authors. Here are the top co-authors by number of shared publications:
- Joan Serra-Sagrista
Dept. of Information and Communications Engineering, Universitat Autònoma de Barcelona, Spain
48 shared publications - Francesc Auli-Llinas
Department of Information and Communications Engineering, Universitat Autònoma de Barcelona, Spain
32 shared publications Victor Sanchez
Univ Warwick, Dept Comp Sci, Coventry CV4 7AL, England
11 shared publicationsMichael W. Marcellin
Department of Electrical and Computing Engineering, University of Arizona, Tucson, AZ, USA
9 shared publicationsIan Blanes
6 shared publications- Miguel Hernandez-Cabronero
Department of Information and Communications Engineering, Universitat Autnoma de Barcelona, Bellaterra, Spain
6 shared publications
Latest Publications
- Open Access
- 1 April 2026
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 138 (4) , 044505
Lossless Compression of Modern Astronomical Data Using a Novel Learned Predictor
The rapid growth of science-ready data volumes generated by modern ground-based astronomical observatories poses significant challenges for data storage and transmission. The de facto standard for storing these data is FITS, which incorporates a limited set of built-in compression methods. In this work, we present a novel lossless compression approach for astronomical images based on a weighted linear predictor combined with a CCSDS 123.0-B-2 mapper and a contextual binary arithmetic encoder. Three predictor configurations are evaluated, ranging from handcrafted designs to an optimized, dataset-adaptive model. Experimental results show consistent improvements over state-of-the-art lossless compressors. The optimized predictor achieves the best performance, improving compression by up to 0.471 bits per pixel (6.40%) compared to the best-performing FITS compressor, FPACK Hcompress. When applied to large-scale instruments such as the VLT, this corresponds to a reduction of approximately 0.25 TB per day (4.48%), yielding annual storage savings exceeding 90 TB. The implementation is publicly available at https://github.com/xavifeme00/Astronomy-Compressor .
- 1 April 2026
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 138 (4) , 044505
Open AccessLossless Compression of Modern Astronomical Data Using a Novel Learned Predictor
The rapid growth of science-ready data volumes generated by modern ground-based astronomical observatories poses significant challenges for data storage and transmission. The de facto standard for storing these data is FITS, which incorporates a limited set of built-in compression methods. In this work, we present a novel lossless compression approach for astronomical images based on a weighted linear predictor combined with a CCSDS 123.0-B-2 mapper and a contextual binary arithmetic encoder. Three predictor configurations are evaluated, ranging from handcrafted designs to an optimized, dataset-adaptive model. Experimental results show consistent improvements over state-of-the-art lossless compressors. The optimized predictor achieves the best performance, improving compression by up to 0.471 bits per pixel (6.40%) compared to the best-performing FITS compressor, FPACK Hcompress. When applied to large-scale instruments such as the VLT, this corresponds to a reduction of approximately 0.25 TB per day (4.48%), yielding annual storage savings exceeding 90 TB. The implementation is publicly available at https://github.com/xavifeme00/Astronomy-Compressor .
- Open Access
- 20 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Robustness of Lossy Multispectral Compression to Simulated Instrumental Noise: A Comparative Study
Lossy compression of multispectral data has been widely adopted to tackle the downlink bottleneck in space-based Earth observation. However, compression artifacts may interact with the instrumental noise inherent to the sensors, affecting both the performance of the compressors and the effectiveness of denoising techniques. This letter evaluates the effects of lossy compression in the presence of instrumental noise and the corresponding denoising procedures on multispectral data, comparing current techniques for on-board lossy compression (CCSDS 122.0-B-1, near-lossless CCSDS 123.0-B-2, JPEG 2000, and exogenous KLT-JPEG 2000) with recent reduced-complexity models based on neural networks (MCOS and SORTENY). The rate-distortion performance of each codec is analysed across four simulated instrumental noise conditions: thermal noise, dark signal, missing lines and parallax-induced band misalignment. Experimental results show that all the evaluated codecs are resilient under thermal noise, dark signal and missing line artifacts. However, for band misalignment artifacts, the compressors using a linear spectral transform, as E-KLT-JPEG 2000 and SORTENY, experienced a significant degradation.
- 20 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Open AccessRobustness of Lossy Multispectral Compression to Simulated Instrumental Noise: A Comparative Study
Lossy compression of multispectral data has been widely adopted to tackle the downlink bottleneck in space-based Earth observation. However, compression artifacts may interact with the instrumental noise inherent to the sensors, affecting both the performance of the compressors and the effectiveness of denoising techniques. This letter evaluates the effects of lossy compression in the presence of instrumental noise and the corresponding denoising procedures on multispectral data, comparing current techniques for on-board lossy compression (CCSDS 122.0-B-1, near-lossless CCSDS 123.0-B-2, JPEG 2000, and exogenous KLT-JPEG 2000) with recent reduced-complexity models based on neural networks (MCOS and SORTENY). The rate-distortion performance of each codec is analysed across four simulated instrumental noise conditions: thermal noise, dark signal, missing lines and parallax-induced band misalignment. Experimental results show that all the evaluated codecs are resilient under thermal noise, dark signal and missing line artifacts. However, for band misalignment artifacts, the compressors using a linear spectral transform, as E-KLT-JPEG 2000 and SORTENY, experienced a significant degradation.
- Open Access
- 24 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Learned Spectral and Spatial Transforms for Multispectral Remote Sensing Data Compression
As more and more multispectral and hyperspectral platforms are deployed for Earth Observation, limited downlink capacity increases the pressure for more efficient data compression algorithms. Machine Learning (ML) has been successfully applied to produce highly competitive compression models, though this performance has typically been at the cost of high computational complexity, a crucial limitation for on board remote sensing data compression. To address these issues, a reduced-complexity multispectral and hyperspectral data compression architecture is proposed. Using separate spectral and spatial transforms, the complexity of the proposed models is scalable on the number of bands, regardless of the compression ratios. This proposal outperforms state-of-the-art ML compression models as well as established lossy compression methods such as JPEG 2000 prepended with a spectral Karhunen-Lo‘eve Transform (KLT) on a variety of remote sensing data sources. The performance improvement is achieved with a lower complexity than said ML models. To reproduce our results, training and test data is publicly available at https://gici.uab.cat/GiciWebPage/datasets.php and source code at https://github.com/smijares/mbhs2025.
- 24 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Open AccessLearned Spectral and Spatial Transforms for Multispectral Remote Sensing Data Compression
As more and more multispectral and hyperspectral platforms are deployed for Earth Observation, limited downlink capacity increases the pressure for more efficient data compression algorithms. Machine Learning (ML) has been successfully applied to produce highly competitive compression models, though this performance has typically been at the cost of high computational complexity, a crucial limitation for on board remote sensing data compression. To address these issues, a reduced-complexity multispectral and hyperspectral data compression architecture is proposed. Using separate spectral and spatial transforms, the complexity of the proposed models is scalable on the number of bands, regardless of the compression ratios. This proposal outperforms state-of-the-art ML compression models as well as established lossy compression methods such as JPEG 2000 prepended with a spectral Karhunen-Lo‘eve Transform (KLT) on a variety of remote sensing data sources. The performance improvement is achieved with a lower complexity than said ML models. To reproduce our results, training and test data is publicly available at https://gici.uab.cat/GiciWebPage/datasets.php and source code at https://github.com/smijares/mbhs2025.
- Open Access
- 1 November 2024
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 136 (11) , 114506
Lossy Compression of Integer Astronomical Images Preserving Photometric Properties*
Observatories are producing astronomical image data at quickly increasing rates. As a result, the efficiency of the compression methods employed is critical to meet the storage and distribution requirements of both observatories and scientists. This paper presents a novel lossy compression technique that is able to preserve the results of photometry analysis with high fidelity while improving upon the state of the art in terms of compression performance. The proposed compression pipeline combines a flexible bi-region quantization scheme with the lossless, dictionary-based, LPAQ9M encoder. The quantization process allows compression performance and photometric fidelity to be precisely tailored to different scientific requirements. A representative data set of 16-bit integer astronomical images produced by telescopes from all around the world has been employed to empirically assess its compression-fidelity trade-offs, and compare them to those of the de facto standard Fpack compressor. In these experiments, the widespread SExtractor software is employed as the ground truth for photometric analysis. Results indicate that after lossy compression with our proposed method, the decompressed data allows consistent detection of over 99% of all astronomical objects for all tested telescopes, maintaining the highest photometric fidelity (as compared to state of the art lossy techniques). When compared to the best configuration of Fpack (Hcompress lossy using 1 quantization parameter) at similar compression rates, our proposed method provides better photometry precision: 7.15% more objects are detected with magnitude errors below 0.01, and 9.13% more objects with magnitudes below SExtractor’s estimated measurement error. Compared to the best lossless compression results, the proposed pipeline allows us to reduce the compressed data set volume by up to 38.75% and 27.94% while maintaining 90% and 95%, respectively, of the detected objects with magnitude differences lower than 0.01 mag; and up to 18.93% while maintaining 90% of the detected objects with magnitude differences lower than the photometric measure error.
- 1 November 2024
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 136 (11) , 114506
Open AccessLossy Compression of Integer Astronomical Images Preserving Photometric Properties*
Observatories are producing astronomical image data at quickly increasing rates. As a result, the efficiency of the compression methods employed is critical to meet the storage and distribution requirements of both observatories and scientists. This paper presents a novel lossy compression technique that is able to preserve the results of photometry analysis with high fidelity while improving upon the state of the art in terms of compression performance. The proposed compression pipeline combines a flexible bi-region quantization scheme with the lossless, dictionary-based, LPAQ9M encoder. The quantization process allows compression performance and photometric fidelity to be precisely tailored to different scientific requirements. A representative data set of 16-bit integer astronomical images produced by telescopes from all around the world has been employed to empirically assess its compression-fidelity trade-offs, and compare them to those of the de facto standard Fpack compressor. In these experiments, the widespread SExtractor software is employed as the ground truth for photometric analysis. Results indicate that after lossy compression with our proposed method, the decompressed data allows consistent detection of over 99% of all astronomical objects for all tested telescopes, maintaining the highest photometric fidelity (as compared to state of the art lossy techniques). When compared to the best configuration of Fpack (Hcompress lossy using 1 quantization parameter) at similar compression rates, our proposed method provides better photometry precision: 7.15% more objects are detected with magnitude errors below 0.01, and 9.13% more objects with magnitudes below SExtractor’s estimated measurement error. Compared to the best lossless compression results, the proposed pipeline allows us to reduce the compressed data set volume by up to 38.75% and 27.94% while maintaining 90% and 95%, respectively, of the detected objects with magnitude differences lower than 0.01 mag; and up to 18.93% while maintaining 90% of the detected objects with magnitude differences lower than the photometric measure error.
- Open Access
- 5 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 36702-36711
Resiliency and Efficiency of the CCSDS 124.0-B-1 Telemetry Compression Standard
The Consultative Committee for Space Data Systems (CCSDS) recently published a lossless compression standard for housekeeping and telemetry. These data are critical for the safe and productive operation of virtually all remote sensing missions, including Earth observation. The new standard, CCSDS 124.0-B-1 “Robust Compression of Fixed-Length Housekeeping Data,” allows lossless, real-time telemetry packet transmission with low energy and memory requirements. Furthermore, it offers flexible resiliency mechanisms to resume decompression after losing one or more data packets. This work provides an accessible introduction to CCSDS 124.0-B-1, paying special attention to its resiliency features. Two novel and complementary decoder resynchronization strategies are also presented, which maximize the amount of correctly decoded data. Comprehensive experiments with real and simulated mission data were conducted for this work to assess the standard’s performance and the impact of user-defined parameters. Results indicate competitive coding performance, with average compression ratios between 4 and 16 depending on the dataset. Smooth trade-offs are also observed between compression performance and the degree of protection against data loss events, which enhances the usability of CCSDS 124.0-B-1 in multiple mission types and operational conditions.
- 5 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 36702-36711
Open AccessResiliency and Efficiency of the CCSDS 124.0-B-1 Telemetry Compression Standard
The Consultative Committee for Space Data Systems (CCSDS) recently published a lossless compression standard for housekeeping and telemetry. These data are critical for the safe and productive operation of virtually all remote sensing missions, including Earth observation. The new standard, CCSDS 124.0-B-1 “Robust Compression of Fixed-Length Housekeeping Data,” allows lossless, real-time telemetry packet transmission with low energy and memory requirements. Furthermore, it offers flexible resiliency mechanisms to resume decompression after losing one or more data packets. This work provides an accessible introduction to CCSDS 124.0-B-1, paying special attention to its resiliency features. Two novel and complementary decoder resynchronization strategies are also presented, which maximize the amount of correctly decoded data. Comprehensive experiments with real and simulated mission data were conducted for this work to assess the standard’s performance and the impact of user-defined parameters. Results indicate competitive coding performance, with average compression ratios between 4 and 16 depending on the dataset. Smooth trade-offs are also observed between compression performance and the degree of protection against data loss events, which enhances the usability of CCSDS 124.0-B-1 in multiple mission types and operational conditions.
- 5 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Removing Data Dependencies in the CCSDS 123.0-B-2 Predictor Weight Updating
The Consultative Committee for Space Data Systems (CCSDS) first standardized near-lossless coding capabilities in the CCSDS 123.0-B-2 algorithm. However, this standard does not describe strategies to produce high-throughput hardware implementations, which are not trivial to derive from its definition. At the same time, throughput optimizations without significant compression performance penalty are paramount to enable real-time compression on-board next-generation satellites. This work demonstrates that the weight update stage of the CCSDS 123.0-B-2 predictor can be selectively bypassed to enhance throughput for both lossless and near-lossless modes with minimal impact on compression performance and still produce fully compliant bitstreams. Skipping the weight update implies that those weights must be carefully chosen outside the original CCSDS 123.0-B-2 pipeline. Two strategies are proposed to select effective weight values based on whether a priori information about the current image is exploited or not. Comprehensive experimental results are presented for both proposed strategies and for lossless and near-lossless regimes, using a representative set of hyperspectral images. The coding penalty is, on average, 1% for lossless and 8% for near-lossless, depending on the strategy used to set the initial weights. The proposed method obtains a maximum throughput of 1 processed sample per clock cycle when it is evaluated using High-Level Synthesis (HLS), consuming 4.6% of the LUTs and 31.1% of the internal memory on a Xilinx Kintex UltraScale space-grade FPGA.
- 5 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Removing Data Dependencies in the CCSDS 123.0-B-2 Predictor Weight Updating
The Consultative Committee for Space Data Systems (CCSDS) first standardized near-lossless coding capabilities in the CCSDS 123.0-B-2 algorithm. However, this standard does not describe strategies to produce high-throughput hardware implementations, which are not trivial to derive from its definition. At the same time, throughput optimizations without significant compression performance penalty are paramount to enable real-time compression on-board next-generation satellites. This work demonstrates that the weight update stage of the CCSDS 123.0-B-2 predictor can be selectively bypassed to enhance throughput for both lossless and near-lossless modes with minimal impact on compression performance and still produce fully compliant bitstreams. Skipping the weight update implies that those weights must be carefully chosen outside the original CCSDS 123.0-B-2 pipeline. Two strategies are proposed to select effective weight values based on whether a priori information about the current image is exploited or not. Comprehensive experimental results are presented for both proposed strategies and for lossless and near-lossless regimes, using a representative set of hyperspectral images. The coding penalty is, on average, 1% for lossless and 8% for near-lossless, depending on the strategy used to set the initial weights. The proposed method obtains a maximum throughput of 1 processed sample per clock cycle when it is evaluated using High-Level Synthesis (HLS), consuming 4.6% of the LUTs and 31.1% of the internal memory on a Xilinx Kintex UltraScale space-grade FPGA.
- Open Access
- 22 January 2024
- Published by Elsevier in Signal Processing: Image Communication
- Vol. 123
Prediction-based coding with rate control for lossless region of interest in pathology imaging
- 22 January 2024
- Published by Elsevier in Signal Processing: Image Communication
- Vol. 123
Open AccessPrediction-based coding with rate control for lossless region of interest in pathology imaging
- Open Access
- 8 September 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4422
A Scalable Reduced-Complexity Compression of Hyperspectral Remote Sensing Images Using Deep Learning
Two key hurdles to the adoption of Machine Learning (ML) techniques in hyperspectral data compression are computational complexity and scalability for large numbers of bands. These are due to the limited computing capacity available in remote sensing platforms and the high computational cost of compression algorithms for hyperspectral data, especially when the number of bands is large. To address these issues, a channel clusterisation strategy is proposed, which reduces the computational demands of learned compression methods for real scenarios and is scalable for different sources of data with varying numbers of bands. The proposed method is compatible with an embedded implementation for state-of-the-art on board hardware, a first for a ML hyperspectral data compression method. In terms of coding performance, our proposal surpasses established lossy methods such as JPEG 2000 preceded by a spectral Karhunen-Loève Transform (KLT), in clusters of 3 to 7 bands, achieving a PSNR improvement of, on average, 9 dB for AVIRIS and 3 dB for Hyperion images.
- 8 September 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4422
Open AccessA Scalable Reduced-Complexity Compression of Hyperspectral Remote Sensing Images Using Deep Learning
Two key hurdles to the adoption of Machine Learning (ML) techniques in hyperspectral data compression are computational complexity and scalability for large numbers of bands. These are due to the limited computing capacity available in remote sensing platforms and the high computational cost of compression algorithms for hyperspectral data, especially when the number of bands is large. To address these issues, a channel clusterisation strategy is proposed, which reduces the computational demands of learned compression methods for real scenarios and is scalable for different sources of data with varying numbers of bands. The proposed method is compatible with an embedded implementation for state-of-the-art on board hardware, a first for a ML hyperspectral data compression method. In terms of coding performance, our proposal surpasses established lossy methods such as JPEG 2000 preceded by a spectral Karhunen-Loève Transform (KLT), in clusters of 3 to 7 bands, achieving a PSNR improvement of, on average, 9 dB for AVIRIS and 3 dB for Hyperion images.
- 12 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 19 (1545598X) , 1-5
Reducing Data Dependencies in the Feedback Loop of the CCSDS 123.0-B-2 Predictor
On-board multi- and hyperspectral instruments acquire large volumes of data that need to be processed with the limited computational and storage resources. In this context, the CCSDS 123.0-B-2 standard emerges as an interesting option to compress multi- and hyperspectral images on-board satellites, supporting both lossless and near-lossless compression with low complexity and reduced power consumption. Nonetheless, the inclusion of a feedback loop in the CCSDS 123.0-B-2 predictor to support near-lossless compression introduces significant data dependencies that hinder real-time processing, particularly due to the presence of a quantization stage within this loop. This work provides an analysis of the aforementioned data dependencies and proposes two strategies aiming at maximizing throughput in hardware implementations and thus enabling real-time processing. In particular, through an elaborate mathematical derivation, the quantization stage is removed completely from the feedback loop. This reduces the critical path, which allows for shorter initiation intervals in a pipelined hardware implementation and higher throughput. This is achieved without any impact in the compression performance, which is identical to the one obtained by the original data flow of the predictor.
- 12 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 19 (1545598X) , 1-5
Reducing Data Dependencies in the Feedback Loop of the CCSDS 123.0-B-2 Predictor
On-board multi- and hyperspectral instruments acquire large volumes of data that need to be processed with the limited computational and storage resources. In this context, the CCSDS 123.0-B-2 standard emerges as an interesting option to compress multi- and hyperspectral images on-board satellites, supporting both lossless and near-lossless compression with low complexity and reduced power consumption. Nonetheless, the inclusion of a feedback loop in the CCSDS 123.0-B-2 predictor to support near-lossless compression introduces significant data dependencies that hinder real-time processing, particularly due to the presence of a quantization stage within this loop. This work provides an analysis of the aforementioned data dependencies and proposes two strategies aiming at maximizing throughput in hardware implementations and thus enabling real-time processing. In particular, through an elaborate mathematical derivation, the quantization stage is removed completely from the feedback loop. This reduces the critical path, which allows for shorter initiation intervals in a pipelined hardware implementation and higher throughput. This is achieved without any impact in the compression performance, which is identical to the one obtained by the original data flow of the predictor.
- 1 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 389-398
Analysis of Lossless Compressors Applied to Integer and Floating-Point Astronomical Data
In this work, lossless compression algorithms are evaluated on a variety of real, current as-tronomical images. The test dataset comprises raw (integer) and processed (floating-point) images of discrete and extensive astronomical objects, captured by spatial or terrestrial tele-scopes. Compression techniques herein analyzed are chosen to be representative of the most recent algorithms devised for astronomical data, as well as the most commonly employed compressors employed in real observatories. Experimental results suggest that coding techniques such as RICE and HCOMPRESS, typically employed in world-class observatories such as Roque de los Muchachos, do not produce the best possible lossless compression results. Instead, JPEG-LS, LZMA and NDZIP yield the best compression ratio results for 16-bit data (2.72), floating-point data (2.38) and radio data (1.81), respectively. Therefore, the efficiency with which data are stored and transmitted by these observatories could be significantly improved by selectively employing the aforementioned algorithms.
- 1 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 389-398
Analysis of Lossless Compressors Applied to Integer and Floating-Point Astronomical Data
In this work, lossless compression algorithms are evaluated on a variety of real, current as-tronomical images. The test dataset comprises raw (integer) and processed (floating-point) images of discrete and extensive astronomical objects, captured by spatial or terrestrial tele-scopes. Compression techniques herein analyzed are chosen to be representative of the most recent algorithms devised for astronomical data, as well as the most commonly employed compressors employed in real observatories. Experimental results suggest that coding techniques such as RICE and HCOMPRESS, typically employed in world-class observatories such as Roque de los Muchachos, do not produce the best possible lossless compression results. Instead, JPEG-LS, LZMA and NDZIP yield the best compression ratio results for 16-bit data (2.72), floating-point data (2.38) and radio data (1.81), respectively. Therefore, the efficiency with which data are stored and transmitted by these observatories could be significantly improved by selectively employing the aforementioned algorithms.