Discovery of concept entities from web sites using web unit mining.

by Ming Yin Ming, Dion Hoe-lian Goh, Ee-Peng Lim, Aixin Sun
International Journal of Web Information Systems ()
Get full text at journal


A web site usually contains a large number of concept entities, each consisting of one or more web pages connected by hyperlinks. In order to discover these concept entities for more expressive web site queries and other applications, the web unit mining problem has been proposed. Web unit mining aims to determine web pages that constitute a concept entity and classify concept entities into categories. Nevertheless, the performance of an existing web unit mining algorithm, iWUM, suffers as it may create more than one web unit (incomplete web units) from a single concept entity. This paper presents two methods to solve this problem. The first method introduces a more effective web fragment construction method so as reduce later classification errors. The second method incorporates site-specific knowledge to discover and handle incomplete web units. Experiments show that incomplete web units can be removed and overall accuracy has been significantly improved, especially on the precision and F1 measures. Adapted from the source document.

Cite this document (BETA)

Readership Statistics

6 Readers on Mendeley
by Discipline
67% Computer and Information Science
17% Management Science / Operations Research
by Academic Status
50% Ph.D. Student
17% Researcher (at a non-Academic Institution)
17% Assistant Professor
by Country
33% Portugal
17% India

Sign up today - FREE

Mendeley saves you time finding and organizing research. Learn more

  • All your research in one place
  • Add and import papers easily
  • Access it anywhere, anytime

Start using Mendeley in seconds!

Sign up & Download

Already have an account? Sign in