Developments in Probabilistic Modelling with Neural Networks — Ensemble Learning

Abstract

Ensemble learning by variational free energyminimization is a framework for statisticalinference in which an ensemble of parameter vectorsis optimized rather than a single parameter vector.The ensemble approximates the posterior probabilitydistribution of the parameters. In this paper Igive a review of ensemble learning using a simpleexample.