Sparse density estimation with ℓ1 penalties

Abstract

This paper studies oracle properties of ℓ1-penalized estimators of a probability density. We show that the penalized least squares estimator satisfies sparsity oracle inequalities, i.e., bounds in terms of the number of non-zero components of the oracle vector. The results are valid even when the dimension of the model is (much) larger than the sample size. They are applied to estimation in sparse high-dimensional mixture models, to nonparametric adaptive density estimation and to the problem of aggregation of density estimators. © Springer-Verlag Berlin Heidelberg 2007.