As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance. However there are several methods to construct the ensemble. In this paper we present some new results in a comparison of twenty different methods. We have trained ensembles of 3, 9, 20 and 40 networks to show results in a wide spectrum of values. The results show that the improvement in performance above 9 networks in the ensemble depends on the method but it is usually low. Also, the best method for a ensemble of 3 networks is called "Decorrelated" and uses a penalty term in the usual Backpropagation function to decorrelate the networks outputs in the ensemble. For the case of 9 and 20 networks the best method is conservative boosting. And finally for 40 networks the best method is Cels. © Springer-Verlag Berlin Heidelberg 2005.
CITATION STYLE
Torres-Sospedra, J., Hernández-Espinosa, C., & Fernández-Redondo, M. (2005). New results on ensembles of multilayer feedforward. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 3697 LNCS, pp. 139–144). https://doi.org/10.1007/11550907_23
Mendeley helps you to discover research relevant for your work.