Evaluation framework for automatic ontology extraction tools: An experiment

Abstract

Ontologies have become increasingly important in many areas. Building ontology, however, is a time-consuming activity which requires many resources. Consequently, the need for the automatic ontology extraction tool has been increased for the last two decades, and many tools have been developed for this purpose. Yet, there is no comprehensive framework for evaluating such tools. In this paper, we identified important tool evaluation metrics and developed a set of criteria that guide us to evaluate the quality of ontology extraction tools. We carried out experiments and assessed four popular extraction tools using our proposed evaluation framework. The proposed framework can be applied as a useful benchmark when developers want to build ontology extraction tools. © Springer-Verlag Berlin Heidelberg 2007.