RSTIndex: Indexing and retrieving web document using computational and linguistic techniques

Abstract

The amount of information available on the Internet is currently growing at an incredible rate. However, the lack of efficient indexing is still a major barrier to effective information retrieval on the web. This paper presents a new technique for capturing the semantic of the document to be used for indexing and retrieval of relevant document from the Internet. It performs the conventional keyword based indexing and introduces a thematic relationship between parts of text using natural language understanding (NLU) and a linguistics theory called rhetorical structure theory (RST). © Springer-Verlag Berlin Heidelberg 2002.