1. A survey of pipelined workflow scheduling
- Author
-
Ümit V. Çatalyürek, Anne Benoit, Yves Robert, Erik Saule, Algorithms and Scheduling for Distributed Heterogeneous Platforms (GRAAL), Inria Grenoble - Rhône-Alpes, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire de l'Informatique du Parallélisme (LIP), École normale supérieure de Lyon (ENS de Lyon)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure de Lyon (ENS de Lyon)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Centre National de la Recherche Scientifique (CNRS), Laboratoire de l'Informatique du Parallélisme (LIP), Université de Lyon-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS), Department of Biomedical Informatics [Columbus], Ohio State University [Columbus] (OSU), Optimisation des ressources : modèles, algorithmes et ordonnancement (ROMA), ANR-10-BLAN-0301,RESCUE,Résilience des applications scientifiques sur machines exascales(2010), École normale supérieure - Lyon (ENS Lyon)-Université Claude Bernard Lyon 1 (UCBL), and Université de Lyon-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure - Lyon (ENS Lyon)-Université Claude Bernard Lyon 1 (UCBL)
- Subjects
General Computer Science ,parallel systems ,Computer science ,Distributed computing ,0102 computer and information sciences ,02 engineering and technology ,Parallel computing ,algorithms ,01 natural sciences ,Structuring ,Theoretical Computer Science ,Scheduling (computing) ,Workflow technology ,models ,0202 electrical engineering, electronic engineering, information engineering ,filter-stream programming ,Workflow scheduling ,scheduling ,throughput ,latency ,distributed systems ,020203 distributed computing ,Job shop scheduling ,pipeline ,workflow programming ,Workflow ,010201 computation theory & mathematics ,Programming paradigm ,[INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC] ,Algorithm ,Workflow management system - Abstract
A large class of applications need to execute the same workflow on different datasets of identical size. Efficient execution of such applications necessitates intelligent distribution of the application components and tasks on a parallel machine, and the execution can be orchestrated by utilizing task, data, pipelined, and/or replicated parallelism. The scheduling problem that encompasses all of these techniques is called pipelined workflow scheduling , and it has been widely studied in the last decade. Multiple models and algorithms have flourished to tackle various programming paradigms, constraints, machine behaviors, or optimization goals. This article surveys the field by summing up and structuring known results and approaches.
- Published
- 2013