Ghosh, Nikhil

9 publications

JMLR 2025 The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning Nikhil Ghosh, Spencer Frei, Wooseok Ha, Bin Yu

ICML 2024 LoRA+: Efficient Low Rank Adaptation of Large Models Soufiane Hayou, Nikhil Ghosh, Bin Yu

ICLR 2024 More Is Better: When Infinite Overparameterization Is Optimal and Overfitting Is Obligatory James B Simon, Dhruva Karkada, Nikhil Ghosh, Mikhail Belkin

NeurIPS 2024 The Impact of Initialization on LoRA Finetuning Dynamics Soufiane Hayou, Nikhil Ghosh, Bin Yu

NeurIPS 2023 Alternating Updates for Efficient Transformers Cenk Baykal, Dylan Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

ICLR 2023 Deconstructing Distributions: A Pointwise Framework of Learning Gal Kaplun, Nikhil Ghosh, Saurabh Garg, Boaz Barak, Preetum Nakkiran

NeurIPSW 2022 Gradient Dynamics of Single-Neuron Autoencoders on Orthogonal Data Nikhil Ghosh, Spencer Frei, Wooseok Ha, Bin Yu

ICLR 2022 The Three Stages of Learning Dynamics in High-Dimensional Kernel Methods Nikhil Ghosh, Song Mei, Bin Yu

NeurIPS 2019 Landmark Ordinal Embedding Nikhil Ghosh, Yuxin Chen, Yisong Yue