BioCreative II.5 and the FEBS Letters Experiment on Structured Digital Abstracts

Abstract

DefinitionBioCreative is a community challenge to evaluate applied systems in biomedical text-mining. In the context of the third installment of this challenge, BioCreative II.5, the feasibility of using automated text-mining systems for protein–protein interaction (PPI) database curation was evaluated. In parallel, FEBS Letters asked manuscript authors to annotate their manuscripts with protein interaction information. The author information then was further utilized by MINT PPI curators to compare the impact of basing their work on the author data against their performance when starting from scratch. The BioCreative organizers evaluated the performance of the curators, authors, and automated systems individually. Then, curator annotations based on author data, as well as combined annotations from all text mining systems, and combining author and automated systems’ data was compared to those individual results. Finally, the annotation overlap between curators, authors, and t