SAGS: A SLA-aware green scheduling in heterogeneous cloud using hadoop YARN

Abstract

The Apache Hadoop with cloud had become an emerging and popular service. Irrespective of its huge dominance in large scale data processing, it has challenges yet to be addressed. The primary challenges in yarn scheduler are the abilities to automate and control the resource allocation to different workloads in order to meet the deadline-based Service Level Agreement (SLA) in the cloud environment with optimal energy consumption. Our study with the Hadoop YARN addresses this problem in a controlled homogeneous environment. In cloud datacenters, heterogeneity had become a normal phenomenon. Hence, this paper proposes the problem of energy-aware heterogeneous Hadoop Yarn cloud with deadline based SLA. We proposed a SLA-Aware Green Scheduling (SAGS), a Dynamic Voltage/Frequency Scaling (DVFS) based approach along with SLA-Aware scheduling algorithm in the heterogeneous environment. We evaluated SAGS by using benchmark datasets and, compared its performance with previously proposed solutions. Our observation with experimental results shows that, the proposed approach outperforms existing approaches.