Discovery of Concept Entities from Web Sites using Web Unit Mining.

Yin M, Goh D, Lim E, Sun A ...see all

IJWIS, vol. 1, issue 3 (2005) pp. 123-135

  • 8


    Mendeley users who have this article in their library.
  • 4


    Citations of this article.
  • N/A


    ScienceDirect users who have downloaded this article.
Sign in to save reference


This paper presents a novel method for extracting information from collections of Web pages across different sites. Our method uses a standard wrapper induction algorithm and exploits named entity information. We introduce the idea of post-processing the extraction results for resolving ambiguous facts and improve the overall extraction performance. Postprocessing involves the exploitation of two additional sources of information: fact transition probabilities, based on a trained bigram model, and confidence probabilities, estimated for each fact by the wrapper induction system. A multiplicative model that is based on the product of those two probabilities is also considered for post-processing. Experiments were conducted on pages describing laptop products, collected from many different sites and in four different languages. The results highlight the effectiveness of our approach.

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

Get full text


  • Ming Yin

  • Dion Hoe-Lian Goh

  • Ee-Peng Lim

  • Aixin Sun

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free