Stopped Training and Other Remedies for Overfitting

Abstract

Overfitting is the most serious problem in neural network training; stopped training is the most common solution to this problem. Yet the neural network literature contains little systematic investigation of the properties of stopped training and no comparisons with statistical methods of dealing with overfitting. This paper presents the results of simulations designed to investigate these issues.