Mind change efficient learning

12Citations
Citations of this article
6Readers
Mendeley users who have this article in their library.

Abstract

This paper studies efficient learning with respect to mind changes. Our starting point is the idea that a learner that is efficient with respect to mind changes minimizes mind changes not only globally in the entire learning problem, but also locally in subproblems after receiving some evidence. Formalizing this idea leads to the notion of strong mind change optimality. We characterize the structure of language classes that can be identified with at most α mind changes by some learner (not necessarily effective): a language class L is identifiable with α mind changes iff the accumulation order of L is at most α. Accumulation order is a classic concept from point-set topology. We show that accumulation order is related to other established notions of structural complexity, such as thickness and intrinsic complexity. To aid the construction of learning algorithms, we show that the characteristic property of strongly mind change optimal learners is that they output conjectures (languages) with maximal accumulation order. We illustrate the theory by describing strongly mind change optimal learners for various problems such as identifying linear subspaces, one-variable patterns, and fixed-length patterns. © 2006 Elsevier Inc. All rights reserved.

Cite

CITATION STYLE

APA

Luo, W., & Schulte, O. (2006). Mind change efficient learning. Information and Computation, 204(6), 989–1011. https://doi.org/10.1016/j.ic.2006.02.004

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free