This paper introduces a new technique for phrase-structure parser analysis, categorizing possible treebank structures by integrating regular expressions into derivation trees. We analyze the performance of the Berkeley parser on OntoNotes WSJ and the English Web Treebank. This provides some insight into the evalb scores, and the problem of domain adaptation with the web data. We also analyze a "test-ontrain" dataset, showing a wide variance in how the parser is generalizing from different structures in the training material. © 2014 Association for Computational Linguistics.
CITATION STYLE
Kulick, S., Bies, A., Mott, J., Kroch, A., Liberman, M., & Santorini, B. (2014). Parser evaluation using derivation trees: A complement to evalb. In 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference (Vol. 2, pp. 668–673). Association for Computational Linguistics (ACL). https://doi.org/10.3115/v1/p14-2109
Mendeley helps you to discover research relevant for your work.