ML-CIDIM: Multiple layers of multiple classifier systems based on CIDIM

Abstract

An active research area in Machine Learning is the construction of multiple classifier systems to increase learning accuracy of simple classifiers. In this paper we present a method to improve even more the accuracy: ML-CIDIM. This method has been developed by using a multiple classifier system which basic classifier is CIDIM, an algorithm that induces small and accurate decision trees. CIDIM makes a random division of the training set into two subsets and uses them to build an internal bound condition. ML-CIDIM induces some multiple classifier systems based on CIDIM and places them in different layers, trying to improve the accuracy of the previous layer with the following one. In this way, the accuracy obtained thanks to a unique multiple classifier system based on CIDIM can be improved. In reference to the accuracy of the classifier system built with ML-CIDIM, we can say that it competes well against bagging and boosting at statistically significant confidence levels. © Springer-Verlag Berlin Heidelberg 2005.