Extreme extraction - Machine reading in a week

  • Freedman M
  • Ramshaw L
  • Boschee E
 et al. 
  • 35


    Mendeley users who have this article in their library.
  • 0


    Citations of this article.


We report on empirical results in extreme extraction. It is extreme in that (1) from receipt of the ontology specifying the target concepts and relations, development is limited to one week and that (2) relatively little training data is assumed. We are able to surpass human recall and achieve an F1 of 0.51 on a question-answering task with less than 50 hours of effort using a hybrid approach that mixes active learning, bootstrapping, and limited (5 hours) manual rule writing. We compare the performance of three systems: extraction with handwritten rules, bootstrapped extraction, and a combination. We show that while the recall of the handwritten rules surpasses that of the learned system, the learned system is able to improve the overall recall and F1. © 2011 Association for Computational Linguistics.

Author-supplied keywords

  • Active Learning
  • Computational linguistics
  • Empirical results
  • Hybrid approac
  • Natural language processing systems
  • Ontology

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Marjorie Freedman

  • Lance Ramshaw

  • Elizabeth Boschee

  • Ryan Gabbard

  • Gary Kratkiewicz

  • Nicolas Ward

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free