Skip to main content
Journal Article

Dynamics of gradient-based learning and applications to hyperparameter estimation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2004) 2690 369-376
DOI: 10.1007/978-3-540-45080-1_48
1Citations
Citations of this article
1Readers
Mendeley users who have this article in their library.
Get full text

Abstract

We analyse the dynamics of gradient-based learning algorithms using the cavity method, considering the cases of batch learning with non-vanishing rates, and on-line learning. It has an an excellent agreement with simulations. Applications to efficient and precise estimation of hyperparameters are proposed. © Springer-Verlag 2003.

Cite

CITATION STYLE

APA

Wong, K. Y. M., Luo, P., & Li, F. (2004). Dynamics of gradient-based learning and applications to hyperparameter estimation. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2690, 369–376. https://doi.org/10.1007/978-3-540-45080-1_48

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free