Risk bounds for mixture density estimation

Abstract

In this paper we focus on the problem of estimating a, bounded density using a, finite combination of densities from a, given class. We consider the Maximum Likelihood Estimator (MLE) and the greedy procedure described by Li and Barron (1999) under the additional assumption of boundedness of densities. We prove an O(1/√n) bound on the estimation error which does not depend on the number of densities in the estimated combination. Under the boundedness assumption, this improves the bound of Li and Barron by removing the log n factor and also generalizes it to the base classes with converging Dudley integral. © EDP Sciences, SMAI 2005.