A grouping method for categorical attributes having very large number of values

Abstract

In supervised machine learning, the partitioning of the values (also called grouping) of a categorical attribute aims at constructing a new synthetic attribute which keeps the information of the initial attribute and reduces the number of its values. In case of very large number of values, the risk of overfilling ihe data increases sharply and building good groupings becomes difficult In ihis paper, we propose two new grouping methods founded on a Bayesian approach, leading lo Bayes optimal groupings. The first method exploits a standard schema for grouping models and the second one extends this schema by managing a "garbage" group dedicated to the least frequent values. Extensive comparative experiments demonstrate that the new grouping methods build high quality groupings in terms of predictive quality, robustness and small number of groups. © Springer-Verlag Berlin Heidelberg 2005.