A Beginner’s Guide to the Mathematics of Neural Networks

Abstract

In this paper I try to describe both the role of mathematics in shaping our understanding of ho w neural net orks operate, and the curious w new mathematical concepts generated b y our attempts to capture neural net orks in equations. My target reader being the non-expert, I will present a biased selection of relativ ely simple examples of neural net ork w tasks, models and calculations, rather than try to giv e a full encyclopedic review-lik e accoun t of the man y mathematical dev elopmen ts in this field.