Shallow parsing based on maximum matching method and scoring model

Abstract

Shallow Parsing is a very important task in Natural Language Processing or Text Mining, and the partial syntactical information can help to solve many other natural language processing tasks. In this paper, we split the task of shallow parsing into two subtasks: (1) Seeking all the Break Points to divide a Part-of-Speech(POS) sequence into some groups; (2) Tagging a phrase type for each POS group. In the first, we present the Break Point Seeking (BPS) algorithm.which is combination of Scoring Model (SM) and Maximum Matching Method (MM), to solve the first subtask. Then,we used the Bayes classifier to tag the phrase structure type for each POS group. The result shows that although our method did not apply any syntactic rules, the BPS algorithm, which combined the MM with SM algorithm, exerted the strongpoint of the MM and SM algorithm, obtained a favorable performance. © 2008 IEEE.