CoXCS: A coevolutionary learning classifier based on feature space partitioning

Abstract

Learning classifier systems (LCSs) are a machine learning technique, which combine reinforcement learning and evolutionary algorithms to evolve a set of classifiers (or rules) for pattern classification tasks. Despite promising performance across a variety of data sets, the performance of LCS is often degraded when data sets of high dimensionality and relatively few instances are encountered, a common occurrence with gene expression data. In this paper, we propose a number of extensions to XCS, a widely used accuracy-based LCS, to tackle such problems. Our model, CoXCS, is a coevolutionary multi-population XCS. Isolated sub-populations evolve a set of classifiers based on a partitioning of the feature space in the data. Modifications to the base XCS framework are introduced including an algorithm to create the match set and a specialized crossover operator. Experimental results show that the accuracy of the proposed model is significantly better than other well-known classifiers when the ratio of data features to samples is extremely large. © Springer-Verlag Berlin Heidelberg 2009.