A Survey of Scaling Distributed System Via Machine Learning and An Insight on Hadoop and Spark

Abstract

This survey present and discuss distributed computing framework and distributed machine learning with evaluating the results of 10 papers on machine learning and big data. The first half discussed distributed computing framework, Hadoop and Spark. We briefly explained each structure and compared the key features between them. The second half consists of the survey in distributed machine learning. We briefly described the representative techniques as well as popular frameworks and discussed the major problem and challenges behind them used in different papers for scaling of distributed system via machine learning and big data techniques.