Using managed high performance computing systems for high-throughput computing

Abstract

This chapter will explore the issue of executing High-Throughput Computing (HTC) workflows on managed High Performance Computing (HPC) systems that have been tailored for the execution of “traditional” HPC applications. We will first define data-oriented workflows and HTC, and then highlight some of the common hurdles that exist to executing these workflows on shared HPC resources. Then we will look at Launcher, which is a tool for making large HTC workflows appear-from the HPC system’s perspective-to be a “traditional” simulation workflow. Launcher’s various features are described, including scheduling modes and extensions for use with Intel®Xeon Phi™ coprocessor cards.