When performing a learning task on voluminous data, memory and computational time can become prohibitive. In this chapter, we propose a framework aimed at estimating the parameters of a density mixture on training data in a compressive manner by computing a low-dimensional sketch of the data. The sketch represents empirical moments of the underlying probability distribution. Instantiating the framework on the case where the densities are isotropic Gaussians, we derive a reconstruction algorithm by analogy with compressed sensing. We experimentally show that it is possible to precisely estimate the mixture parameters provided that the sketch is large enough, while consuming less memory in the case of numerous data. The considered framework also provides a privacy-preserving data analysis tool, since the sketch does not disclose information about individual datum it is based on.
CITATION STYLE
Bourrier, A., Gribonval, R., & Pérez, P. (2015). Compressive gaussian mixture estimation. In Applied and Numerical Harmonic Analysis (pp. 239–258). Springer International Publishing. https://doi.org/10.1007/978-3-319-16042-9_8
Mendeley helps you to discover research relevant for your work.