Scaling Laws for the Principled Design, Initialization, and Preconditioning of ReLU Networks

Defazio and Bottou. "Scaling Laws for the Principled Design, Initialization, and Preconditioning of ReLU Networks." International Conference on Learning Representations, 2020.

[Defazio and Bottou. "Scaling Laws for the Principled Design, Initialization, and Preconditioning of ReLU Networks." International Conference on Learning Representations, 2020.](https://mlanthology.org/iclr/2020/defazio2020iclr-scaling/)

@inproceedings{defazio2020iclr-scaling,
  title     = {{Scaling Laws for the Principled Design, Initialization, and Preconditioning of ReLU Networks}},
  author    = {Defazio, Aaron and Bottou, Leon},
  booktitle = {International Conference on Learning Representations},
  year      = {2020},
  url       = {https://mlanthology.org/iclr/2020/defazio2020iclr-scaling/}
}