The Heterogeneous Bulk Synchronous Parallel model

Abstract

T rends in parallel computing indicate that heterogeneous parallel computing will be one of the most widespread platforms for computation-intensive applications. A heterogeneous computing environment offers considerably more computational power at a lower cost than a parallel computer. We propose the Heterogeneous Bulk Synchronous Parallel (HBSP) model, which is based on the BSP model of parallel computation, as a framework for dev eloping applications for heterogeneous parallel environments. HBSP enhances the applicability of the BSP model by incorporating parameters that reflect the relative speeds of the heterogeneous computing components. Moreover, w e demonstrate the utility of the model by developing parallel algorithms for heterogeneous systems. © 2000 Springer-Verlag Berlin Heidelberg.