A constructive approach to parsing with neural networks. The hybrid connectionist parsing method

Abstract

The concept of Dynamic Neural Networks (DNN) is a new approach within the Neural Network paradigm, which is based on the dynamic construction of Neural Networks during the processing of an input. The DNN methodology has been employed in the Hybrid Connectionist Parsing (HCP) approach, which comprises an incremental, on-line generation of a Neural Network parse tree. The HCP ensures an adequate representation and processing of recursively defined structures, like grammar-based languages. In this paper, we describe the general principles of the HCP method and some of its specific Neural Network features. We outline and discuss the use of the HCP method with respect to parallel processing of ambiguous structures, and robust parsing of extra-grammatical inputs in the context of spoken language parsing.