FPGA-accelerated streaming data reduction achieving an average compression ratio over 8000 in a 17.4 kHz, 840 kpixel CITIUS detector for quasi-elastic gamma-ray scattering
Open Access
- 25 March 2026
- journal article
- research article
- Published by International Union of Crystallography (IUCr) in Journal of Synchrotron Radiation
- Vol. 33 (3) , 609-616
Abstract
We present a data-acquisition and -analysis framework for quasi-elastic gamma-ray scattering (QEGS) experiments at BL35XU of SPring-8, equipped with an 840 kpixel CITIUS X-ray detector operating at 17.4 kHz. The detector produces data at 27 GB s −1 (216 Gbps), and typical experiments involve acquisition over beam-time periods longer than 24 h, generating datasets of 2.3 PB per day. To handle this volume, we constructed a data-handling pipeline consisting of the detector, data reduction at the beamline and analysis tools at the data center. The data reduction employs field-programmable gate array (FPGA)-accelerated per-pixel processing to reduce data entropy, followed by Zstandard compression on CPUs, achieving an average compression ratio of over 8000. The compressed data are transferred to the SPring-8 data center within two to three minutes of data acquisition. At the data center, analysis tools are provided via the Open OnDemand platform, enabling incremental integration and spectral analysis through a web-based interface without the need for high-performance-computing command-line interaction. This data-handling pipeline has been applied in QEGS user experiments, where it enabled timely feedback on experimental data, with integrated results available within six minutes and spectral analysis within seven minutes of integration.Keywords
Funding Information
- Japan Society for the Promotion of Science (24K00592)
- Core Research for Evolutional Science and Technology (JPMJCR2095)
This publication has 20 references indexed in Scilit:
- Discovery of collective nonjumping motions leading to Johari–Goldstein process of stress relaxation in model ionic glassActa Materialia, 2024
- High-efficiency energy-domain multiline gamma-ray quasi-elastic scattering spectroscopy using triple absorbersInteractions, 2024
- Broadband Quasielastic Scattering Spectroscopy Using a Multiline Frequency Comblike Spectrum in the Hard X-Ray RegionPhysical Review Letters, 2024
- The false beat signal of a high-speed X-ray imaging detector for synchrotron radiation experiments and its elimination with a synchronized CITIUS detectorNuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 2023
- Microscopic observation of hidden Johari-Goldstein-β process in glycerolPhysical Review E, 2022
- Relationship between Viscosity and Acyl Tail Dynamics in Lipid BilayersPhysical Review Letters, 2021
- ESRF Data Policy, Storage, and ServicesSynchrotron Radiation News, 2019
- Synchrotron radiation-based quasi-elastic scattering using time-domain interferometry with multi-line gamma raysScientific Reports, 2017
- Time-domain interferometry experiments using multi-line nuclear absorbersHyperfine Interactions, 2011
- Time-sliced Mössbauer absorption spectroscopy using synchrotron radiation and a resonant Bragg monochromatorJournal of Applied Physics, 1996