Rajput, Shashank

16 publications

ICML 2024 Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth, Stefanos Laskaridis, Shashank Rajput, Hongyi Wang

ICML 2023 Looped Transformers as Programmable Computers Angeliki Giannou, Shashank Rajput, Jy-Yong Sohn, Kangwook Lee, Jason D. Lee, Dimitris Papailiopoulos

ICLRW 2023 Looped Transformers as Programmable Computers Angeliki Giannou, Shashank Rajput, Jy-yong Sohn, Kangwook Lee, Jason D. Lee, Dimitris Papailiopoulos

NeurIPSW 2023 Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth, Stefanos Laskaridis, Shashank Rajput, Hongyi Wang

NeurIPS 2023 Recommender Systems with Generative Retrieval Shashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan, Trung Vu, Lukasz Heldt, Lichan Hong, Yi Tay, Vinh Tran, Jonah Samost, Maciej Kula, Ed Chi, Maheswaran Sathiamoorthy

COLT 2023 The Expressive Power of Tuning Only the Normalization Layers Angeliki Giannou, Shashank Rajput, Dimitris Papailiopoulos

AISTATS 2022 Finding Nearly Everything Within Random Binary Networks Kartik Sreenivasan, Shashank Rajput, Jy-Yong Sohn, Dimitris Papailiopoulos

NeurIPS 2022 LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks Tuan Dinh, Yuchen Zeng, Ruisu Zhang, Ziqian Lin, Michael Gira, Shashank Rajput, Jy-yong Sohn, Dimitris Papailiopoulos, Kangwook Lee

ICLR 2022 Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond Chulhee Yun, Shashank Rajput, Suvrit Sra

ICLR 2022 Permutation-Based SGD: Is Random Optimal? Shashank Rajput, Kangwook Lee, Dimitris Papailiopoulos

NeurIPS 2021 An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks Shashank Rajput, Kartik Sreenivasan, Dimitris Papailiopoulos, Amin Karbasi

NeurIPS 2020 Attack of the Tails: Yes, You Really Can Backdoor Federated Learning Hongyi Wang, Kartik Sreenivasan, Shashank Rajput, Harit Vishwakarma, Saurabh Agarwal, Jy-yong Sohn, Kangwook Lee, Dimitris Papailiopoulos

ICML 2020 Closing the Convergence Gap of SGD Without Replacement Shashank Rajput, Anant Gupta, Dimitris Papailiopoulos

NeurIPS 2020 Optimal Lottery Tickets via Subset Sum: Logarithmic Over-Parameterization Is Sufficient Ankit Pensia, Shashank Rajput, Alliot Nagle, Harit Vishwakarma, Dimitris Papailiopoulos

NeurIPS 2019 DETOX: A Redundancy-Based Framework for Faster and More Robust Gradient Aggregation Shashank Rajput, Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos

ICML 2019 Does Data Augmentation Lead to Positive Margin? Shashank Rajput, Zhili Feng, Zachary Charles, Po-Ling Loh, Dimitris Papailiopoulos