Distributed data mining on the grid

Abstract

Distributed data mining (DDM) is widely used in industrial, scientific and commercial applications to analyze large data sets maintained over geographically distributed sites, which makes DDM a major research issue on today's data mining system. As a latest member in distributed computing technology family, the grid computing can play an increasingly important role with the progress of the DDM technology in recent years. This paper analyzed the drawback of existing DDM systems and put forward a service-oriented architecture of DDM on the grid. The mining algorithm and distributed data sets in the proposed framework are abstracted as Web Service Resource (WS-Resource), which can cooperate to perform DDM as required dynamically. Finally, a grid based on local area network was built with Globus Toolkit 4.0Beta and the algorithm of WS-Resource, dataset WS-Resource for data mining on the grid are developed. © 2005 IEEE.