Paquette, Elliot

9 publications

NeurIPS 2025 Dimension-Adapted Momentum Outscales SGD Damien Ferbach, Katie Everett, Gauthier Gidel, Elliot Paquette, Courtney Paquette

ICML 2025 Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects Ke Liang Xiao, Noah Marshall, Atish Agarwala, Elliot Paquette

ICLR 2025 To CLIP or Not to CLIP: The Dynamics of SGD with Gradient Clipping in High-Dimensions Noah Marshall, Ke Liang Xiao, Atish Agarwala, Elliot Paquette

NeurIPS 2024 4+3 Phases of Compute-Optimal Neural Scaling Laws Elliot Paquette, Courtney Paquette, Lechao Xiao, Jeffrey Pennington

NeurIPS 2024 The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms Elizabeth Collins-Woodfin, Inbar Seroussi, Begoña García Malaxechebarría, Andrew W. Mackenzie, Elliot Paquette, Courtney Paquette

NeurIPS 2022 Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions Courtney Paquette, Elliot Paquette, Ben Adlam, Jeffrey Pennington

NeurIPS 2022 Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions Kiwon Lee, Andrew Cheng, Elliot Paquette, Courtney Paquette

NeurIPS 2021 Dynamics of Stochastic Momentum Methods on Large-Scale, Quadratic Models Courtney Paquette, Elliot Paquette

COLT 2021 SGD in the Large: Average-Case Analysis, Asymptotics, and Stepsize Criticality Courtney Paquette, Kiwon Lee, Fabian Pedregosa, Elliot Paquette