A website model-supported focused crawler for search agents

Abstract

This paper advocates the use of ontology-supported website models to provide a semantic level solution for a search agent so that it can provide fast, precise, and stable search results. We have based on the technique to develop a focused crawler, which can benefit both user requests and domain semantics. Equipped with this technique, our focused crawler manifests the following interesting features: ontology-supported construction of website models, website models-supported website model expansion, and website models-supported webpage retrieval.