We present a method to cluster data sets too large to fit in memory, based on a Low-Memory Factored Representation (LMFR). The LMFR represents the original data in a factored form with much less memory, while preserving the individuality of each of the original samples. The scalable clustering algorithm Principal Direction Divisive Partitioning (PDDP) can use the factored form in a natural way to obtain a clustering of the original dataset. The resulting algorithm is the PieceMeal PDDP (PMPDDP) method. The scalability of PMPDDP is demonstrated with a complexity analysis and experimental results. A discussion on the practical use of this method by a casual user is provided. © 2006 Springer-Verlag Berlin Heidelberg.
CITATION STYLE
Littau, D., & Boley, D. (2006). Clustering very large data sets with principal direction divisive partitioning. In Grouping Multidimensional Data: Recent Advances in Clustering (pp. 99–126). Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-28349-8_4
Mendeley helps you to discover research relevant for your work.