History of Neural Networks

Abstract

Here we are presenting a brief history of neural networks, given in Haykin (Neural networks: a comprehensive foundation, 2002) [7], Zurada (Intro-duction to artificial neural systems, 2001) [8], Nielsen (Neurocomputing, 1990 [9] in terms of the development of architectures and algorithms that are widely used today. The history of neural networks has been divided in four stages: Beginning of neural networks, First golden age, Quiet Years and Renewed enthusiasm which shows the interplay among biological experimentation, modeling and computer simulation, hardware implementation.