CPU-GPU Utilization Aware Energy-Efficient Scheduling Algorithm on Heterogeneous Computing Systems

Abstract

Nowadays, heterogeneous computing systems have proven to be a good solution for processing computation intensive high-performance applications. The main challenges for such large-scale systems are energy consumption, computing node CPU-GPU utilization dynamic variability, and so on. In response to these challenges, this study first provides heterogeneous computing systems architecture and parallel application job model. Then, we build system computing node CPU-GPU utilization model and analyze job execution energy consumption. We also deduce the optimal CPU-GPU utilization and job deadline scheduling constraint. Third, we propose a systems CPU-GPU utilization aware and energy-efficient heuristic greedy strategy (UEJS) to solve this job scheduling problem. To improve the algorithm global optimization ability, we design a hybrid particle swarm optimization algorithm (H-PSO), which incorporates the heuristic greedy strategy into the bio-inspired search optimization technique. The rigorous experimental results clearly demonstrate that our proposed H-PSO outperforms heuristic greedy strategy, Max-EAMin, and Genetic Algorithm in terms of the average energy consumption of jobs and system job rejection rate. In particular, H-PSO is better than UEJS by 36.5%, Max-EAMin by 36.3%, and GA by 46.7% in term of the job average energy consumption for heterogeneous system with high workload.