Consistency of Learning Processes

Abstract

The goal of this part of the theory is to describe the conceptual model for learning processes that are based on the empirical risk minimization inductive principle. This part of the theory has to explain when a learning machine that minimizes empirical risk can achieve a small value of actual risk (can generalize) and when it cannot. In other words, the goal of this part is to describe necessary and sufficient conditions for the consistency of learning processes that minimize the empirical risk.