Abstract
Use of software containers and services in science is a rising trend that is not satisfied by the HPC computing resources often available in research contexts. We propose a method to grow Kubernetes clusters onto transient nodes allocated through the Grid Engine batch workload manager. The method is being used to run a mix of data-intensive service applications and bursty HPC-style workflows on an OpenStack-based Kubernetes deployment, while keeping a homogeneous job management, logging, monitoring, and storage infrastructure. Moreover, it is relatively straightforward to convert the implementation to be compatible with other workload managers.
Author supplied keywords
Cite
CITATION STYLE
Piras, M. E., Pireddu, L., Moro, M., & Zanetti, G. (2019). Container Orchestration on HPC Clusters. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 11887 LNCS, pp. 25–35). Springer. https://doi.org/10.1007/978-3-030-34356-9_3
Register to see more suggestions
Mendeley helps you to discover research relevant for your work.