Fresh information retrieval using cooperative meta search engines

Abstract

In web page retrievals, search engines are usually used. However, conventional search engines have a problem in that their update intervals are very longb ecause they are based on centralized architecture, which gathers documents using robots. So we proposed the Cooperative Search Engine (CSE) in order to reduce the update interval. CSE is a distributed search engine, which integrates small local search engines into a large global search engine by using local meta search engines. A local meta search engine hides a local search engine in each web site. Although CSE can reduce the update interval, the retrieval performance is not enough. So, we proposed several speed up techniques. In this paper, we describe the structure and behavior of CSE and its efficiency.