Loshchilov, Ilya

4 publications

ICLR 2025 nGPT: Normalized Transformer with Representation Learning on the Hypersphere Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun, Boris Ginsburg

ICLR 2019 Decoupled Weight Decay Regularization Ilya Loshchilov, Frank Hutter

IJCAI 2018 Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari Patryk Chrabaszcz, Ilya Loshchilov, Frank Hutter

ICLR 2017 SGDR: Stochastic Gradient Descent with Warm Restarts Ilya Loshchilov, Frank Hutter