Dynamics of Training
Abstract
A new method to calculate the full training process of a neural net(cid:173) work is introduced. No sophisticated methods like the replica trick are used. The results are directly related to the actual number of training steps. Some results are presented here, like the maximal learning rate, an exact description of early stopping, and the neces(cid:173) sary number of training steps. Further problems can be addressed with this approach.
Cite
Text
Bös and Opper. "Dynamics of Training." Neural Information Processing Systems, 1996.Markdown
[Bös and Opper. "Dynamics of Training." Neural Information Processing Systems, 1996.](https://mlanthology.org/neurips/1996/bos1996neurips-dynamics/)BibTeX
@inproceedings{bos1996neurips-dynamics,
title = {{Dynamics of Training}},
author = {Bös, Siegfried and Opper, Manfred},
booktitle = {Neural Information Processing Systems},
year = {1996},
pages = {141-147},
url = {https://mlanthology.org/neurips/1996/bos1996neurips-dynamics/}
}