Integrating slurm batch system with European and Polish grid infrastructures

Abstract

ICM, one of the major Polish HPC resource providers, migrated to the Slurm batch system as the first site in the PL-Grid and WLCG grid infrastructures. This article describes the Slurm integration issues and the solutions developed. The integration was focused on several areas where grid middleware interacts with the batch scheduling system, additionally taking into consideration the PL-Grid specifics. In particular, the resource usage accounting required a dedicated Slurm support and the scientific grants enforcement policy needed a new implementation. What is more, in this work we present the reasons of the Slurm adoption and other improvements that were necessary to handle the increasing load of the grid site.