Smith, Samuel L.

8 publications

ICML 2024 Universality of Linear Recurrences Followed by Non-Linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues Antonio Orvieto, Soham De, Caglar Gulcehre, Razvan Pascanu, Samuel L Smith

ICLR 2023 Deep Transformers Without Shortcuts: Modifying Self-Attention for Faithful Signal Propagation Bobby He, James Martens, Guodong Zhang, Aleksandar Botev, Andrew Brock, Samuel L Smith, Yee Whye Teh

ICML 2023 Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto, Samuel L Smith, Albert Gu, Anushan Fernando, Caglar Gulcehre, Razvan Pascanu, Soham De

ICLR 2021 Characterizing Signal Propagation to Close the Performance Gap in Unnormalized ResNets Andrew Brock, Soham De, Samuel L Smith

ICML 2021 High-Performance Large-Scale Image Recognition Without Normalization Andy Brock, Soham De, Samuel L Smith, Karen Simonyan

ICLR 2021 On the Origin of Implicit Regularization in Stochastic Gradient Descent Samuel L Smith, Benoit Dherin, David Barrett, Soham De

ICLR 2018 Don't Decay the Learning Rate, Increase the Batch Size Samuel L. Smith, Pieter-Jan Kindermans, Chris Ying, Quoc V. Le

ICLR 2017 Offline Bilingual Word Vectors, Orthogonal Transformations and the Inverted SoftMax Samuel L. Smith, David H. P. Turban, Steven Hamblin, Nils Y. Hammerla