How comma selection helps with the escape from local optima

Abstract

We investigate (1,λ) ESs using isotropic mutations for optimization in ℝn by means of a theoretical runtime analysis. In particular, a constant offspring-population size λ will be of interest. We start off by considering an adaptation-less (1,2) ES minimizing a linear function. Subsequently, a piecewise linear function with a jump/cliff is considered, where a (1+λ) ES gets trapped, i. e., (at least) an exponential (in n) number of steps are necessary to escape the local-optimum region. The (1,2) ES, however, manages to overcome the cliff in an almost unnoticeable number of steps. Finally, we outline (because of the page limit) how the reasoning and the calculations can be extended to the scenario where a (1,λ) ES using Gaussian mutations minimizes CLIFF, a bimodal, spherically symmetric function already considered in the literature, which is merely SPHERE with a jump in the function value at a certain distance from the minimum. For λ a constant large enough, the (1,λ) ES manages to conquer the global-optimum region - in contrast to (1+λ) ESs which get trapped. © Springer-Verlag Berlin Heidelberg 2006.