Document clustering refers to unsupervised classification (categorization) of documents into groups (clusters) in such a way that the documents in a cluster are similar, whereas dissimilar documents are assigned in different clusters. The documents may be web pages, blog posts, news articles, or other text files. A popular and computationally efficient clustering technique is flat clustering. Unlike hierarchical techniques, flat clustering algorithms aim to partition the document space into groups of similar documents. The cluster assignments however may be hard or soft. This paper presents our experimental work on evaluating some hard and soft flat-clustering algorithms, namely K-means, heuristic k-means and fuzzy C-means, for categorizing text documents. We experimented with different representations (tf, tf.idf, Boolean) and feature selection schemes (with or without stop word removal and with or without stemming) on some standard datasets. The results indicate that tf.idf representation and the use of stemming obtains better clustering. Moreover, fuzzy clustering obtains better results than K-means on almost all datasets, and is also a more stable method. © 2013 Springer-Verlag.
CITATION STYLE
Singh, V. K., Siddiqui, T. J., & Singh, M. K. (2012). Evaluating hard and soft flat-clustering algorithms for text documents. In Advances in Intelligent Systems and Computing (Vol. 179 AISC, pp. 63–76). Springer Verlag. https://doi.org/10.1007/978-3-642-31603-6_6
Mendeley helps you to discover research relevant for your work.