ZLZarija Lukić

Zarija Lukić

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Zarija Lukić has a total of 55 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Analytic compression of the effective field theory of the Lyman-alpha forest

    by Naim Göksel Karaçaylı, Mikhail M. Ivanov, Roger de Belsunce, Corentin Ravoux, Jean M. Sexton, Zarija Lukić

    The 1D flux power spectrum ( P 1D ) of the Lyα forest provides an exceptionally high-resolution probe of structure formation down to small scales ( k ≈1 – 10 h Mpc -1 ). These scales carry the imprints of massive neutrinos, warm dark matter, and the running of the primordial power spectrum spectral index. The effective field theory (EFT) is a promising perturbative approach to systematically and efficiently describe the Lyα forest, but it faces challenges in its application to P 1D , as many EFT parameters become degenerate when projected along the line of sight. In addition, this projection generates new stochastic terms from the integration over small-scale modes. In this work, we address these issues by compressing the EFT model space using the Fisher matrix formalism and linearizing the resulting compression directions, enabling analytic template marginalization and significantly reducing the computational cost of likelihood evaluation. We use hydrodynamical simulations to obtain a baseline estimate of EFT parameters, and use the DESI DR1 P 1D measurements to derive compression directions. We then marginalize over deviations from the baseline using these compression directions and forecast the constraining power of our formalism. We find that even in conservative scenarios where each data redshift bin requires its own set of EFT parameters, the cosmological constraints saturate with the linear bias, two leading-order 1D stochastic terms, and three principal combinations of the remaining EFT templates. In this case, our forecasted precision of the amplitude (Δ 2 p ) and the logarithmic slope ( n p ) of the linear matter power spectrum at the pivot scale ( k p =0.7 Mpc -1 ) is 10% and 2.0%, respectively, which is similar to emulator-based analyses that include observational data systematics.


  • Open Access

    FFCz: Fast Fourier Correction for Spectrum-Preserving Lossy Compression of Scientific Data

    by Congrong Ren, Robert Underwood, Sheng Di, Emrecan Kutay, Zarija Lukic, Aylin Yener, Franck Cappello, Hanqi Guo

    This paper introduces a novel technique to preserve spectral features in lossy compression based on a novel fast Fourier correction algorithm\added{ for regular-grid data}. Preserving both spatial and frequency representations of data is crucial for applications such as cosmology, turbulent combustion, and X-ray diffraction, where spatial and frequency views provide complementary scientific insights. In particular, many analysis tasks rely on frequency-domain representations to capture key features, including the power spectrum of cosmology simulations, the turbulent energy spectrum in combustion, and diffraction patterns in reciprocal space for ptychography. However, existing compression methods guarantee accuracy only in the spatial domain while disregarding the frequency domain. To address this limitation, we propose an algorithm that corrects the errors produced by off-the-shelf ``base'' compressors such as SZ3, ZFP, and SPERR, thereby preserving both spatial and frequency representations by bounding errors in both domains. By expressing frequency-domain errors as linear combinations of spatial-domain errors, we derive a region that jointly bounds errors in both domains. Given as input the spatial errors from a base compressor and user-defined error bounds in the spatial and frequency domains, we iteratively project the spatial error vector onto the regions defined by the spatial and frequency constraints until it lies within their intersection. We further accelerate the algorithm using GPU parallelism to achieve practical performance. We validate our approach with datasets from cosmology simulations, X-ray diffraction, combustion simulation, and electroencephalography demonstrating its effectiveness in preserving critical scientific information in both spatial and frequency domains.

  • Open Access

    DeepCQ: General-Purpose Deep-Surrogate Framework for Lossy Compression Quality Prediction

    by Khondoker Mirazul Mumenin, Robert Underwood, Dong Dai, Jinzhen Wang, Sheng Di, Zarija Lukić, Franck Cappello

    Error-bounded lossy compression techniques have become vital for scientific data management and analytics, given the ever-increasing volume of data generated by modern scientific simulations and instruments. Nevertheless, assessing data quality post-compression remains computationally expensive due to the intensive nature of metric calculations. In this work, we present a general-purpose deep-surrogate framework for lossy compression quality prediction (DeepCQ), with the following key contributions: 1) We develop a surrogate model for compression quality prediction that is generalizable to different error-bounded lossy compressors, quality metrics, and input datasets; 2) We adopt a novel two-stage design that decouples the computationally expensive feature-extraction stage from the light-weight metrics prediction, enabling efficient training and modular inference; 3) We optimize the model performance on time-evolving data using a mixture-of-experts design. Such a design enhances the robustness when predicting across simulation timesteps, especially when the training and test data exhibit significant variation. We validate the effectiveness of DeepCQ on four real-world scientific applications. Our results highlight the framework's exceptional predictive accuracy, with prediction errors generally under 10\% across most settings, significantly outperforming existing methods. Our framework empowers scientific users to make informed decisions about data compression based on their preferred data quality, thereby significantly reducing I/O and computational overhead in scientific data analysis.

  • Open Access

    AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

    by Daoce Wang, Jesus Pulido, Pascal Grosset, Jiannan Tian, Sian Jin, Houjun Tang, Jean Sexton, Sheng Di, Zarija Lukić, Kai Zhao, et al.

    As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 4096 CPU cores demonstrate that AMRIC improves the compression ratio by up to 81X and the I/O performance by up to 39X over AMReX's original compression solution.

  • Open Access

    Mining for Strong Gravitational Lenses with Self-supervised Learning

    by George Stein, Jacqueline Blaum, Peter Harrington, Tomislav Medan, Zarija Lukic

    We employ self-supervised representation learning to distill information from 76 million galaxy images from the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys' Data Release 9. Targeting the identification of new strong gravitational lens candidates, we first create a rapid similarity search tool to discover new strong lenses given only a single labelled example. We then show how training a simple linear classifier on the self-supervised representations, requiring only a few minutes on a CPU, can automatically classify strong lenses with great efficiency. We present 1192 new strong lens candidates that we identified through a brief visual identification campaign, and release an interactive web-based similarity search tool and the top network predictions to facilitate crowd-sourcing rapid discovery of additional strong gravitational lenses and other rare objects: https://github.com/georgestein/ssl-legacysurvey.

  • Open Access

    Mining for Strong Gravitational Lenses with Self-supervised Learning

    by George Stein, Jacqueline Blaum, Peter Harrington, Tomislav Medan, Zarija Lukić

    We employ self-supervised representation learning to distill information from 76 million galaxy images from the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys’ Data Release 9. Targeting the identification of new strong gravitational lens candidates, we first create a rapid similarity search tool to discover new strong lenses given only a single labeled example. We then show how training a simple linear classifier on the self-supervised representations, requiring only a few minutes on a CPU, can automatically classify strong lenses with great efficiency. We present 1192 new strong lens candidates that we identified through a brief visual identification campaign and release an interactive web-based similarity search tool and the top network predictions to facilitate crowd-sourcing rapid discovery of additional strong gravitational lenses and other rare objects: github.com/georgestein/ssl-legacysurvey.


  • Open Access

    Self-supervised similarity search for large scientific datasets

    by George Stein, Peter Harrington, Jacqueline Blaum, Tomislav Medan, Zarija Lukic

    We present the use of self-supervised learning to explore and exploit large unlabeled datasets. Focusing on 42 million galaxy images from the latest data release of the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys, we first train a self-supervised model to distill low-dimensional representations that are robust to symmetries, uncertainties, and noise in each image. We then use the representations to construct and publicly release an interactive semantic similarity search tool. We demonstrate how our tool can be used to rapidly discover rare objects given only a single example, increase the speed of crowd-sourcing campaigns, and construct and improve training sets for supervised applications. While we focus on images from sky surveys, the technique is straightforward to apply to any scientific dataset of any dimensionality. The similarity search web app can be found at https://github.com/georgestein/galaxy_search


  • Open Access

    Self-Supervised Representation Learning for Astronomical Images

    by Abul Hayat, George Stein, Peter Harrington, Zarija Lukić, Mustafa Mustafa

    Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers representations of sky survey images that are semantically useful for a variety of scientific tasks. These representations can be directly used as features, or fine-tuned, to outperform supervised methods trained only on labeled data. We apply a contrastive learning framework on multi-band galaxy photometry from the Sloan Digital Sky Survey (SDSS) to learn image representations. We then use them for galaxy morphology classification, and fine-tune them for photometric redshift estimation, using labels from the Galaxy Zoo 2 dataset and SDSS spectroscopy. In both downstream tasks, using the same learned representations, we outperform the supervised state-of-the-art results, and we show that our approach can achieve the accuracy of supervised models while using 2-4 times fewer labels for training.

  • Open Access

    Simulating intergalactic gas for DESI-like small scale Lymanα forest observations

    by Michael Walther, Eric Armengaud, Corentin Ravoux, Nathalie Palanque-Delabrouille, Christophe Yèche, Zarija Lukić

    Measurements of the Ly$\alpha$ forest based on large numbers of quasar spectra from sky surveys such as SDSS/eBOSS accurately probe the distribution of matter on small scales and thus provide important constraints on several ingredients of the cosmological model. A main summary statistic derived from those measurements is the one-dimensional power spectrum, P1D, of the Ly$\alpha$ absorption. However, model predictions for P1D rely on expensive hydrodynamical simulations of the intergalactic medium, which was the limiting factor in previous analyses. Datasets from upcoming surveys such as DESI will push observational accuracy near the 1%-level and probe even smaller scales. This observational push mandate seven more accurate simulations as well as more careful exploration of parameter space. In this work we evaluate the robustness and accuracy of simulations and the statistical framework used to constrain cosmological parameters. We present a comparison between the grid-based simulation code Nyx and SPH-based code Gadget in the context ofP1D. In addition, we perform resolution and box-size convergence tests using Nyx code. We use a Gaussian process emulation scheme to reduce the number of simulations required for exploration of parameter space without sacrificing the model accuracy. We demonstrate the ability to produce unbiased parameter constraints in an end-to-end inference test using mock eBOSS- and DESI-like data, and we advocate for the usage of adaptive sampling schemes as opposed to using a fixed Latin hypercube design.

  • Open Access

    Cosmic Inference: Constraining Parameters With Observations and Highly Limited Number of Simulations

    by Timur Takhtaganov, Zarija Lukic, Juliane Mueller, Dmitriy Morozov

    Cosmological probes pose an inverse problem where the measurement result is obtained through observations, and the objective is to infer values of model parameters which characterize the underlying physical system -- our Universe. Modern cosmological probes increasingly rely on measurements of the small-scale structure, and the only way to accurately model physical behavior on those scales, roughly 65 Mpc/h or smaller, is via expensive numerical simulations. In this paper, we provide a detailed description of a novel statistical framework for obtaining accurate parameter constraints by combining observations with a very limited number of cosmological simulations. The proposed framework utilizes multi-output Gaussian process emulators that are adaptively constructed using Bayesian optimization methods. We compare several approaches for constructing multi-output emulators that enable us to take possible inter-output correlations into account while maintaining the efficiency needed for inference. Using Lyman alpha forest flux power spectrum, we demonstrate that our adaptive approach requires considerably fewer --- by a factor of a few in Lyman alpha P(k) case considered here --- simulations compared to the emulation based on Latin hypercube sampling, and that the method is more robust in reconstructing parameters and their Bayesian credible intervals.