Themis: A Scalable Performance Evaluation Framework for Virtualized Datacenter

DC/OS is a widely used distributed operating system that abstracts the resources of light-weighted virtualized datacenters, which is based on Mesos distributed systems kernel and user space services such as Marathon. It automates resource management and process scheduling, thus significantly impacts the performance of datacenters. In this paper, we propose Themis, a flexible, automatic and distributed framework, to evaluate the performance and scalability across both DC/OS and virtualization layer. We can integrate most emerging scale-out datacenter workloads into this framework, and get an easily understandable score that scales with underlying system capacity using a configurable controlled strategy.