Back to Search
Start Over
The Pangeo Ecosystem: Interactive Computing Tools for the Geosciences: Benchmarking on HPC
- Source :
- Communications in Computer and Information Science ISBN: 9783030447274, HUST/SE-HER/WIHPC@SC
- Publication Year :
- 2019
- Publisher :
- Juckeland G., Chandrasekaran S. (eds) Tools and Techniques for High Performance Computing. HUST 2019, SE-HER 2019, WIHPC 2019. Communications in Computer and Information Science, vol 1190. Springer, Cham. Print ISBN 978-3-030-44727-4 Online ISBN 978-3-030-44728-1. https://doi.org/10.1007/978-3-030-44728-1_12. pp.190-204 ., 2019.
-
Abstract
- The Pangeo ecosystem is an interactive computing software stack for HPC and public cloud infrastructures. In this paper, we show benchmarking results of the Pangeo platform on two di erent HPC sys- tems. Four di erent geoscience operations were considered in this bench- marking study with varying chunk sizes and chunking schemes. Both strong and weak scaling analyses were performed. Chunk sizes between 64MB to 512MB were considered, with the best scalability obtained for 512MB. Compared to certain manual chunking schemes, the auto chunk- ing scheme scaled well.
- Subjects :
- Interactive computing
Scheme (programming language)
Computer science
business.industry
Xarray
Distributed computing
Cloud computing
02 engineering and technology
Benchmarking
interactive computing
Dask
Software
020204 information systems
Scalability
HPC
0202 electrical engineering, electronic engineering, information engineering
Data_FILES
Pangeo
cloud
020201 artificial intelligence & image processing
benchmarking
business
computer
Chunking (computing)
computer.programming_language
Subjects
Details
- Language :
- English
- ISBN :
- 978-3-030-44727-4
- ISBNs :
- 9783030447274
- Database :
- OpenAIRE
- Journal :
- Communications in Computer and Information Science ISBN: 9783030447274, HUST/SE-HER/WIHPC@SC
- Accession number :
- edsair.doi.dedup.....f5997dae17580558da711e4de2d7cf51