Distributed web service retrieval method

Abstract

This research addresses the problem ofWeb Service Retrieval by presenting a method for Web scale distributed crawling and indexing of Web Services. This paper includes the retrieval of both SOAP and RESTful Web Services and consists of overall architecture of the retrieval system, architecture of the crawler and distributed indexing approach that adapts Google’s MapReduce algorithm. Moreover, the research takes into account new and still unsolved problem of RESTful Web Service identification and data extraction from HTML API documentation pages. The research includes implementation of the approach that allowed to conduct preliminary experiments.