Convergence rate of minimization learning for neural networks

Abstract

we present the convergence rate of the error in a neural network which was learnt by a constructive method. The constructive mechanism is used to learn the neural network by adding hidden units to this neural network. The main idea of this work is to find the eigenvalues of the transformation matrix concerning the error before and after adding hidden units in the neural netwqrk. By using the eigenvalues, we show the relation between the convergence rate in neural networks without and with thresholds in the output layer.