Approximation by series of sigmoidal functions with applications to neural networks

Abstract

In this paper, we develop a constructive theory for approximating absolutely continuous functions by series of certain sigmoidal functions. Estimates for the approximation error are also derived. The relation with neural networks approximation is discussed. The connection between sigmoidal functions and the scaling functions of (Formula presented.) -regular multiresolution approximations are investigated. In this setting, we show that the approximation error for (Formula presented.) -functions decreases as (Formula presented.) , as (Formula presented.). Examples with sigmoidal functions of several kinds, such as logistic, hyperbolic tangent, and Gompertz functions, are given.