Kumar, Tanishq

7 publications

ICLR 2025 Do Mice Grok? Glimpses of Hidden Progress in Sensory Cortex Tanishq Kumar, Blake Bordelon, Cengiz Pehlevan, Venkatesh N Murthy, Samuel J. Gershman

ICML 2025 Overtrained Language Models Are Harder to Fine-Tune Jacob Mitchell Springer, Sachin Goyal, Kaiyue Wen, Tanishq Kumar, Xiang Yue, Sadhika Malladi, Graham Neubig, Aditi Raghunathan

ICLRW 2025 Overtrained Language Models Are Harder to Fine-Tune Jacob Mitchell Springer, Sachin Goyal, Kaiyue Wen, Tanishq Kumar, Xiang Yue, Sadhika Malladi, Graham Neubig, Aditi Raghunathan

ICLR 2025 Scaling Laws for Precision Tanishq Kumar, Zachary Ankner, Benjamin Frederick Spector, Blake Bordelon, Niklas Muennighoff, Mansheej Paul, Cengiz Pehlevan, Christopher Re, Aditi Raghunathan

ICMLW 2024 Asymptotic Dynamics for Delayed Feature Learning in a Toy Model Blake Bordelon, Tanishq Kumar, Samuel J. Gershman, Cengiz Pehlevan

ICLR 2024 Grokking as the Transition from Lazy to Rich Training Dynamics Tanishq Kumar, Blake Bordelon, Samuel J. Gershman, Cengiz Pehlevan

ICML 2024 No Free Prune: Information-Theoretic Barriers to Pruning at Initialization Tanishq Kumar, Kevin Luo, Mark Sellke