HW-STALKER: A machine learning-based approach to transform hidden web data to XML

Abstract

In this paper, we propose an algorithm called HW-Transform for transforming hidden web data to XML format using machine learning by extending STALKER to handle hyperlinked hidden web pages. One of the key features of our approach is that we identify and transform key attributes of query results into XML attributes. These key attributes facilitate applications such as change detection and data integration, by efficiently identifying related or identical results. Based on the proposed algorithm, we have implemented a prototype system called HW-STALKER using Java. Our experiments demonstrate that HW-Transform shows acceptable performance for transforming query results to XML. © Springer-Verlag Berlin Heidelberg 2004.