Distributed data platform system based on hadoop platform

Abstract

Associated with the proposed rapid development of Web2.0, cloud computing, networking concepts, and technologies of the information age increasingly reflect the characteristics of its ‘‘big data.’’ In order to exert the value of large-scale data, data mining technology in many areas of commercial, military, economic, and academic received more and more attention. At the same time, the huge scale of the data is a major challenge to the traditional data mining technology. A combination of data mining and cloud computing is becoming a trend in the industry rely on the robust-processing power provided by cloud computing and other distributed computing platform, and this kind of combination is constantly showing its strong advantages and potential.