Covariate shift and incremental learning

Abstract

Learning strategies under covariate shift have recently been widely discussed. Under covariate shift, the density of learning inputs is different from that of test inputs. In such environments, learning machines need to employ special learning strategies to acquire a greater capability to generalize through learning. However, incremental learning methods are also for learning in non-stationary learning environments, which would represent a kind of covariate-shift. However, the relation between covariate shift environments and incremental learning environments has not been adequately discussed. This paper focuses on the covariate shift in incremental learning environments and our re-construction of a suitable incremental learning method. © 2009 Springer Berlin Heidelberg.