Kunin, Daniel

13 publications

NeurIPS 2025 Alternating Gradient Flows: A Theory of Feature Learning in Two-Layer Neural Networks Daniel Kunin, Giovanni Luca Marchetti, Feng Chen, Dhruva Karkada, James B Simon, Michael R DeWeese, Surya Ganguli, Nina Miolane

ICLR 2025 From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks Clémentine Carla Juliette Dominé, Nicolas Anguita, Alexandra Maria Proca, Lukas Braun, Daniel Kunin, Pedro A. M. Mediano, Andrew M Saxe

NeurIPSW 2024 From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks Clémentine Carla Juliette Dominé, Nicolas Anguita, Alexandra Maria Proca, Lukas Braun, Daniel Kunin, Pedro A. M. Mediano, Andrew M Saxe

NeurIPSW 2024 From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks Clémentine Carla Juliette Dominé, Nicolas Anguita, Alexandra Maria Proca, Lukas Braun, Daniel Kunin, Pedro A. M. Mediano, Andrew M Saxe

NeurIPS 2024 Get Rich Quick: Exact Solutions Reveal How Unbalanced Initializations Promote Rapid Feature Learning Daniel Kunin, Allan Raventós, Clémentine Dominé, Feng Chen, David Klindt, Andrew Saxe, Surya Ganguli

ICMLW 2024 Get Rich Quick: Exact Solutions Reveal How Unbalanced Initializations Promote Rapid Feature Learning Daniel Kunin, Allan Raventos, Clémentine Carla Juliette Dominé, Feng Chen, David Klindt, Andrew M Saxe, Surya Ganguli

NeurIPS 2023 Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks Feng Chen, Daniel Kunin, Atsushi Yamamura, Surya Ganguli

ICLR 2023 The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks Daniel Kunin, Atsushi Yamamura, Chao Ma, Surya Ganguli

ICLR 2021 Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel LK Yamins, Hidenori Tanaka

NeurIPS 2021 Noether’s Learning Dynamics: Role of Symmetry Breaking in Neural Networks Hidenori Tanaka, Daniel Kunin

NeurIPS 2020 Pruning Neural Networks Without Any Data by Iteratively Conserving Synaptic Flow Hidenori Tanaka, Daniel Kunin, Daniel L Yamins, Surya Ganguli

ICML 2020 Two Routes to Scalable Credit Assignment Without Weight Symmetry Daniel Kunin, Aran Nayebi, Javier Sagastuy-Brena, Surya Ganguli, Jonathan Bloom, Daniel Yamins

ICML 2019 Loss Landscapes of Regularized Linear Autoencoders Daniel Kunin, Jonathan Bloom, Aleksandrina Goeva, Cotton Seed