Back to Search Start Over

Data Management Package for the novel data delivery system, ServiceX, and Applications to various physics analysis workflows.

Authors :
Choi, KyungEon
Onyisi, Peter
Source :
EPJ Web of Conferences; 5/6/2024, Vol. 295, p1-6, 6p
Publication Year :
2024

Abstract

Recent developments of HEP software allow novel approaches to physics analysis workflows. The novel data delivery system, ServiceX, can be very effective when accessing a fraction of large datasets at remote grid sites. ServiceX can deliver user-selected columns with filtering and run at scale. We introduce the ServiceX data management package, ServiceX DataBinder, for easy manipulations of ServiceX delivery requests and delivered data using a single configuration file. We show various practical use cases within analysis pipelines that range from a data delivery of a few columns for machine learning study to a data delivery for full-scale physics analysis. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21016275
Volume :
295
Database :
Complementary Index
Journal :
EPJ Web of Conferences
Publication Type :
Conference
Accession number :
177902417
Full Text :
https://doi.org/10.1051/epjconf/202429506008