Assessing forecast skill through cross validation

Abstract

Cross validation provides a relatively accurate measure of an empirical procedure's ability to produce a useful prediction rule from a historical dataset. The method works by omitting observations and then measuring "hindcast' errors from attempts to predict these missing observations from the remaining data. The idea is to remove the information about the omitted observations that would be unavailable in real forecast situations and determine how well the chosen procedure selects prediction rules when such information is deleted. The authors examine the methodology of cross validation and its potential pitfalls in practical applications through a set of examples. -from Authors