Back to Search Start Over

The Cherenkov Telescope Array Observatory workflow management system

Authors :
Arrabito Luisa
Bregeon Johan
Faure Alice
Gueta Orel
Pigoux Natthan
Tsaregorodtsev Andrei
Source :
EPJ Web of Conferences, Vol 295, p 04044 (2024)
Publication Year :
2024
Publisher :
EDP Sciences, 2024.

Abstract

The Cherenkov Telescope Array Observatory (CTAO) is the next generation ground-based observatory for gamma-ray astronomy at very high energies. It is expected to produce about 2 PB of raw data each year and to manage a global data volume which will grow through the years to reach about 100 PB in 2030. In addition, CTAO will require a high computing capacity for data processing and Monte Carlo simulations, of the order of hundreds of millions of CPU HS06 hours per year. To meet these requirements, CTAO will adopt a distributed computing model using 4 academic data centers, and will use the DIRAC framework as its workload management system. In the past ten years, to optimize the instrument design and study its performances, CTAO has used the European Grid Infrastructure (EGI) to run massive Monte Carlo campaigns. In order to handle these campaigns and to automatize simulation and data processing workflows, we have developed a production system prototype based on DIRAC. Recently, we have also developed a user interface allowing for the configuration and submission of complex workflows. In this contribution we present the production system prototype, its user interface for workflow management as well as its application to CTAO workflows.

Subjects

Subjects :
Physics
QC1-999

Details

Language :
English
ISSN :
2100014X
Volume :
295
Database :
Directory of Open Access Journals
Journal :
EPJ Web of Conferences
Publication Type :
Academic Journal
Accession number :
edsdoj.06e3e97eecbb4c558dcc4f365ead03f1
Document Type :
article
Full Text :
https://doi.org/10.1051/epjconf/202429504044