The ALMA Interferometric Pipeline Heuristics
Authors:
- Todd R. HunterTHTodd R. Hunter
- Remy IndebetouwRIRemy Indebetouw
- Crystal L. BroganCBCrystal L. Brogan
- Kristin BerryKBKristin Berry
- Harold FranckeHFHarold Francke
- Vincent C. GeersVGVincent C. Geers
- Laura GómezLGLaura Gómez
- John E. HibbardJHJohn E. Hibbard
- Elizabeth M. HumphreysEHElizabeth M. Humphreys
- Brian R. KentBKBrian R. Kent
- Amanda A. KepleyAKAmanda A. Kepley
Open Access
- 1 July 2023
- journal article
- research article
- Published by IOP Publishing in Publications of the Astronomical Society of the Pacific
- Vol. 135 (1049) , 074501
Abstract
We describe the calibration and imaging heuristics developed and deployed in the Atacama Large Millimeter/submillimeter Array (ALMA) interferometric data processing pipeline, as of ALMA Cycle 9 operations. The pipeline software framework is written in Python, with each data reduction stage layered on top of tasks and toolkit functions provided by the Common Astronomy Software Applications package. This framework supports a variety of tasks for observatory operations, including science data quality assurance, observing mode commissioning, and user reprocessing. It supports ALMA and Very Large Array interferometric data along with ALMA and NRO 45 m single dish data, via different stages and heuristics. In addition to producing calibration tables, calibrated measurement sets, and cleaned images, the pipeline creates a WebLog which serves as the primary interface for verifying the quality assurance of the data by the observatory and for examining the contents of the data by the user. Following the adoption of the pipeline by ALMA Operations in 2014, the heuristics have been refined through annual prioritized development cycles, culminating in a new pipeline release aligned with the start of each ALMA Cycle of observations. Initial development focused on basic calibration and flagging heuristics (Cycles 2–3), followed by imaging heuristics (Cycles 4–5). Further refinement of the flagging and imaging heuristics, including the introduction of parallel processing, proceeded for Cycles 6–7. In the 2020 release, the algorithm to identify channels to use for continuum subtraction and imaging was substantially improved by the addition of a moment difference analysis. A spectral renormalization stage was added for the 2021 release (Cycle 8) to correct high spectral resolution visibility data acquired on targets exhibiting strong celestial line emission in their autocorrelation spectra. The calibration heuristics used in the low signal-to-noise regime were improved for the 2022 release (Cycle 9). In the two most recent Cycles, 97% of ALMA data sets were calibrated and imaged with the pipeline, ensuring long-term automated reproducibility of results. We conclude with a brief description of plans for future additions, including a self-calibration stage, support for multi-configuration imaging, and complete calibration and imaging of full polarization data.Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- Phase correction for ALMA with 183 GHz water vapour radiometersAstronomy & Astrophysics, 2013
- Digital Spectro-Correlator System for the Atacama Compact Array of the Atacama Large Millimeter/Submillimeter ArrayPublications of the Astronomical Society of Japan, 2012
- A multi-scale multi-frequency deconvolution algorithm for synthesis imaging in radio interferometryAstronomy & Astrophysics, 2011
- THE PHYSICAL BASIS OF THE LEAP SECONDThe Astronomical Journal, 2008
- The Atacama Large Millimeter/Submillimeter Array: overview & statusAstrophysics and Space Science, 2007
- The ALMA correlatorAstronomy & Astrophysics, 2006
- The International Earth Rotation and Reference Systems Service (IERS)2004
- Ground-based terahertz CO spectroscopy towards OrionAstronomy & Astrophysics, 2002
- Atmospheric transmission at microwaves (ATM): an improved model for millimeter/submillimeter applicationsIEEE Transactions on Antennas and Propagation, 2001
- A Fourier Transform Spectrometer for Measurement of Atmospheric Transmission at Submillimeter WavelengthsPublications of the Astronomical Society of the Pacific, 2000