Two Approaches to Optimal Annealing
Abstract
We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with dif(cid:173) ferent learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture.
Cite
Text
Leen et al. "Two Approaches to Optimal Annealing." Neural Information Processing Systems, 1997.Markdown
[Leen et al. "Two Approaches to Optimal Annealing." Neural Information Processing Systems, 1997.](https://mlanthology.org/neurips/1997/leen1997neurips-two/)BibTeX
@inproceedings{leen1997neurips-two,
title = {{Two Approaches to Optimal Annealing}},
author = {Leen, Todd K. and Schottky, Bernhard and Saad, David},
booktitle = {Neural Information Processing Systems},
year = {1997},
pages = {301-307},
url = {https://mlanthology.org/neurips/1997/leen1997neurips-two/}
}