1. Enabling Scalable and Extensible Memory-Mapped Datastores in Userspace
- Author
-
Maya Gokhale, Keita Iwabuchi, Roger Pearce, Karim Youssef, and Ivy Bo Peng
- Subjects
mmap ,Computer science ,Concurrency ,Memory-mapped I/O ,computer.software_genre ,Allocator ,Computational Theory and Mathematics ,Hardware and Architecture ,Signal Processing ,Scalability ,Virtual memory ,Operating system ,Concurrent computing ,computer ,System software - Abstract
Exascale workloads are expected to incorporate data-intensive processing in close coordination with traditional physics simulations. These emerging scientific, data-analytics and machine learning applications need to access a wide variety of datastores in flat files and structured databases. Programmer productivity is greatly enhanced by mapping datastores into the application process's virtual memory space to provide a unified “in-memory” interface. Currently, memory mapping is provided by system software primarily designed for generality and reliability. However, scalability at high concurrency is a formidable challenge on exascale systems. Also, there is a need for extensibility to support new datastores potentially requiring HPC data transfer services. In this article, we present UMap , a scalable and extensible userspace service for memory-mapping datastores. Through decoupled queue management, concurrency aware adaptation, and dynamic load balancing, UMap enables application performance to scale even at high concurrency. We evaluate UMap in data-intensive applications, including sorting, graph traversal, database operations, and metagenomic analytics. Our results show that UMap as a userspace service outperforms an optimized kernel-based service across a wide range of intra-node concurrency by 1.22-1.9 ${\times}$ × . We performed two case studies to demonstrate UMap 's extensibility. First, a new datastore residing in remote memory is incorporated into UMap as an application-specific plugin. Second, we present a persistent memory allocator Metall built atop UMap for unified storage/memory.
- Published
- 2022
- Full Text
- View/download PDF