Evaluation and enrichment of stanford parser using an arabic property grammar

Abstract

So far, the Stanford Arabic statistic parser is considered as the best parsing tool in terms of performance compared to other parsers. This performance is not stable and may vary depending on the given corpus. A more detailed method to evaluate this parser may help the users to address the causes of a performance loss. We propose, for this reason, to evaluate the Stanford Parser using the verification of the satisfaction of the syntactic constraints (called, properties) based on the analysis results of the corpus. We may obtain these properties from a reference Arabic property grammar. By the way, we enriched the simple representation of the parsing result with syntactic properties. This allows to explicit several implicit information that are the relations between syntactic units. Therefore, we had both a detailed method for the evaluation of parsers and a more syntactically informative representation for the analysis. We obtained widely detailed and encouraging results.