An optimal task assignment policy and performance diagnosis strategy for heterogeneous Hadoop cluster

Abstract

The goal of the proposed research is to improve the performance of Hadoop-based software running on a heterogeneous cluster. My approach lies in the intersection of machine learning, scheduling and diagnosis. We mainly focus on heterogeneous Hadoop clusters and try to improve the performance by implementing a more efficient scheduler for this class of cluster. Copyright © 2013, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.