In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2022, part of the Conference and Labs of the Evaluation Forum 2022 (CLEF 2022). The ChEMU campaign focuses on information extraction tasks over chemical reactions in patents. The ChEMU 2020 lab provided two information extraction tasks, named entity recognition and event extraction. The ChEMU 2021 lab introduced one more task, anaphora resolution. This year, we re-run all the three tasks with new test data. Together, the tasks support comprehensive automatic chemical patent analysis. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the methods employed by participants of this lab and the results obtained across 22 runs from 3 teams, finding that several submissions achieve better results than the baseline methods prepared by the organizers.
CITATION STYLE
Li, Y., Fang, B., He, J., Yoshikawa, H., Akhondi, S. A., Druckenbrodt, C., … Verspoor, K. (2022). Overview of ChEMU 2022 Evaluation Campaign: Information Extraction in Chemical Patents. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 13390 LNCS, pp. 521–540). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-13643-6_30
Mendeley helps you to discover research relevant for your work.