The Data Quality Monitoring Software for the CMS experiment at the LHC: past, present and future
Open Access
- 17 September 2019
- journal article
- research article
- Published by EDP Sciences in EPJ Web of Conferences
- Vol. 214, 02003
Abstract
The Data Quality Monitoring software is a central tool in the CMS experiment. It is used in the following key environments: (i) Online, for real-time detector monitoring; (ii) Offline, for the prompt-offline-feedback and final fine-grained data quality analysis and certification; (iii) Validation of all the reconstruction software production releases; (iv) Validation in Monte Carlo productions. Though the basic structure of the Run1 DQM system remains the same for Run2, between the Run1 and Run2 periods, the DQM system underwent substantial upgrades in many areas, not only to adapt to the surrounding infrastructure changes, but also to provide improvements to meet the growing needs of the collaboration with an emphasis on more sophisticated methods for evaluating data quality. We need to cope with the higher-energy and -luminosity proton-proton collision data, as well as the data from various special runs, such as Heavy Ion runs. In this contribution, we will describe the current DQM software, structure and workflow in the different environments. We then discuss the performance and our experiences with the DQM system in Run2. The main technical challenges which we have encountered and the solutions adopted during Run2 will also be discussed, including efficient use of memory in multithreading environments. Finally, we present the prospect of a future DQM upgrade with emphasis on functionality and long-term robustness for LHC Run3.Keywords
This publication has 10 references indexed in Scilit:
- Improving data quality monitoring via a partnership of technologies and resources between the CMS experiment at CERN and industryEPJ Web of Conferences, 2019
- Anomaly detection using Deep Autoencoders for the assessment of the quality of the data acquired by the CMS experimentEPJ Web of Conferences, 2019
- The web based monitoring project at the CMS experimentJournal of Physics: Conference Series, 2017
- The Data Quality Monitoring Software for the CMS experiment at the LHCJournal of Physics: Conference Series, 2015
- The CMS Data Quality Monitoring Software: Experience and future improvements2013
- CMS Run Registry: Data Certification Bookkeeping and Publication SystemJournal of Physics: Conference Series, 2011
- CMS data quality monitoring web serviceJournal of Physics: Conference Series, 2010
- CMS data quality monitoring: Systems and experiencesJournal of Physics: Conference Series, 2010
- The CMS dataset bookkeeping serviceJournal of Physics: Conference Series, 2008
- ROOT — An object oriented data analysis frameworkNuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 1997