1. Multi-SPMD Programming Model with YML and XcalableMP
- Author
-
Miwako Tsuji, Matthias S. Müller, Serge G. Petiton, Christian Terboven, Thomas Dufaud, Nahid Emad, Hitoshi Murai, Mitsuhisa Sato, Joachim Protze, Taisuke Boku, RIKEN Center for Computational Science [Kobe] (RIKEN CCS), RIKEN - Institute of Physical and Chemical Research [Japon] (RIKEN), Center for Computational Sciences [Tsukuba] (CCS), Université de Tsukuba = University of Tsukuba, Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Maison de la Simulation (MDLS), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut National de Recherche en Informatique et en Automatique (Inria)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Laboratoire d'Informatique Parallélisme Réseaux Algorithmes Distribués (LI-PaRAD), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ), RWTH Aachen University, and Rheinisch-Westfälische Technische Hochschule Aachen University (RWTH)
- Subjects
020203 distributed computing ,Multi-core processor ,Correctness ,Computer science ,business.industry ,020206 networking & telecommunications ,02 engineering and technology ,Parallel computing ,Set (abstract data type) ,Software ,Scalability ,0202 electrical engineering, electronic engineering, information engineering ,Programming paradigm ,[INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC] ,business ,SPMD ,Implementation - Abstract
This chapter describes a multi-SPMD (mSPMD) programming model and a set of software and libraries to support the mSPMD programming model. The mSPMD programming model has been proposed to realize scalable applications on huge and hierarchical systems. It has been evident that simple SPMD programs such as MPI, XMP, or hybrid programs such as OpenMP/MPI cannot exploit the postpeta- or exascale systems efficiently due to the increasing complexity of applications and systems. The mSPMD programming model has been designed to adopt multiple programming models across different architecture levels. Instead of invoking a single parallel program on millions of processor cores, multiple SPMD programs of moderate sizes can be worked together in the mSPMD programming model. As components of the mSPMD programming model, XMP has been supported. Fault-tolerance features, correctness checks, and some numerical libraries’ implementations in the mSPMD programming model have been presented.
- Published
- 2021
- Full Text
- View/download PDF