Search

Network performance is key to the correct operation of any modern data centre infrastructure or data acquisition (DAQ) system. Hence, it is crucial to ensure the devices employed in the network are carefully selected to meet the required needs. Specialized commercial testers implement standardized tests [1, 2], which benchmark the performance of network devices under reproducible, yet artificial conditions. Netbench is a network-testing framework, relying on commodity servers and NICs, that enables the evaluation of network devices performance for handling traffic-patterns that closely resemble real-life usage, at a reasonably affordable price. We will present the architecture of the Netbench framework, its capabilities and how they complement the use of specialized commercial testers (e.g. competing TCP flows that create temporary congestion provide a good benchmark of buffering capabilities in real-life scenarios). Last but not least, we will describe how CERN used Netbench for performing large scale tests with partial-mesh and full-mesh TCP flows [3], an essential validation point during its most recent high-end routers call for tender.

The ATLAS experiment at the LHC relies on a complex and distributed Trigger and Data Acquisition (TDAQ) system to gather and select particle collision data. The Event Filter (EF) component of the TDAQ system is responsible for executing advanced selection algorithms, reducing the data rate to a level suitable for recording to permanent storage. The EF functionality is provided by a computing farm made up of thousands of commodity servers, each executing one or more processes. Moving the EF farm management towards a solution based on software containers is one of the main themes of the ATLAS TDAQ Phase-II upgrades in the area of the online software; it would make it possible to open new possibilities for fault tolerance, reliability and scalability. This paper presents the results of an evaluation of Kubernetes as a possible orchestrator of the ATLAS TDAQ EF computing farm. Kubernetes is a system for advanced management of containerized applications in large clusters. This paper will first highlight some of the technical solutions adopted to run the offline version of today’s EF software in a Docker container. Then it will focus on some scaling performance measurements executed with a cluster of 1000 CPU cores. In particular, this paper will report about the way Kubernetes scales in deploying containers as a function of the cluster size and show how a proper tuning of the Query per Second (QPS) Kubernetes parameter set can improve the scaling of applications in terms of running replicas. Finally, an assessment will be given about the possibility to use Kubernetes as an orchestrator of the EF computing farm in LHC’s Run 4.