Rawat, Ankit Singh

42 publications

ICLR 2025 Faster Cascades via Speculative Decoding Harikrishna Narasimhan, Wittawat Jitkrittum, Ankit Singh Rawat, Seungyeon Kim, Neha Gupta, Aditya Krishna Menon, Sanjiv Kumar

ICLRW 2025 Universal LLM Routing with Correctness-Based Representation Wittawat Jitkrittum, Harikrishna Narasimhan, Ankit Singh Rawat, Jeevesh Juneja, Zifeng Wang, Chen-Yu Lee, Pradeep Shenoy, Rina Panigrahy, Aditya Krishna Menon, Sanjiv Kumar

ICML 2024 A Statistical Framework for Data-Dependent Retrieval-Augmented Models Soumya Basu, Ankit Singh Rawat, Manzil Zaheer

ICLR 2024 DistillSpec: Improving Speculative Decoding via Knowledge Distillation Yongchao Zhou, Kaifeng Lyu, Ankit Singh Rawat, Aditya Krishna Menon, Afshin Rostamizadeh, Sanjiv Kumar, Jean-François Kagy, Rishabh Agarwal

ICLR 2024 Dual-Encoders for Extreme Multi-Label Classification Nilesh Gupta, Fnu Devvrit, Ankit Singh Rawat, Srinadh Bhojanapalli, Prateek Jain, Inderjit S Dhillon

ICMLW 2024 Efficient Document Ranking with Learnable Late Interactions Himanshu Jain, Ziwei Ji, Sashank J. Reddi, Ankit Singh Rawat, Felix Yu, Aditya Krishna Menon, Sadeep Jayasumana

ICMLW 2024 Efficient Document Ranking with Learnable Late Interactions Himanshu Jain, Ziwei Ji, Ankit Singh Rawat, Andreas Veit, Sadeep Jayasumana, Sashank J. Reddi, Aditya Krishna Menon, Felix Yu

ICMLW 2024 Fine-Grained Analysis of In-Context Linear Estimation Yingcong Li, Ankit Singh Rawat, Samet Oymak

NeurIPS 2024 Fine-Grained Analysis of In-Context Linear Estimation: Data, Architecture, and Beyond Yingcong Li, Ankit Singh Rawat, Samet Oymak

ICMLW 2024 Fine-Grained Analysis of In-Context Linear Estimation: Data, Architecture, and Beyond Yingcong Li, Ankit Singh Rawat, Samet Oymak

ICML 2024 From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers Muhammed Emrullah Ildiz, Yixiao Huang, Yingcong Li, Ankit Singh Rawat, Samet Oymak

ICLR 2024 Language Model Cascades: Token-Level Uncertainty and Beyond Neha Gupta, Harikrishna Narasimhan, Wittawat Jitkrittum, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar

ICLR 2024 Think Before You Speak: Training Language Models with Pause Tokens Sachin Goyal, Ziwei Ji, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar, Vaishnavh Nagarajan

ICML 2024 USTAD: Unified Single-Model Training Achieving Diverse Scores for Information Retrieval Seungyeon Kim, Ankit Singh Rawat, Manzil Zaheer, Wittawat Jitkrittum, Veeranjaneyulu Sadhanala, Sadeep Jayasumana, Aditya Krishna Menon, Rob Fergus, Sanjiv Kumar

TMLR 2024 What Do Larger Image Classifiers Memorise? Michal Lukasik, Vaishnavh Nagarajan, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar

ICML 2023 A Statistical Perspective on Retrieval-Based Models Soumya Basu, Ankit Singh Rawat, Manzil Zaheer

ICML 2023 On the Role of Attention in Prompt-Tuning Samet Oymak, Ankit Singh Rawat, Mahdi Soltanolkotabi, Christos Thrampoulidis

ICLRW 2023 On the Role of Attention in Prompt-Tuning Samet Oymak, Ankit Singh Rawat, Mahdi Soltanolkotabi, Christos Thrampoulidis

ICLR 2023 Serving Graph Compression for Graph Neural Networks Si Si, Felix Yu, Ankit Singh Rawat, Cho-Jui Hsieh, Sanjiv Kumar

ICLR 2023 Supervision Complexity and Its Role in Knowledge Distillation Hrayr Harutyunyan, Ankit Singh Rawat, Aditya Krishna Menon, Seungyeon Kim, Sanjiv Kumar

ICLR 2023 Teacher Guided Training: An Efficient Framework for Knowledge Transfer Manzil Zaheer, Ankit Singh Rawat, Seungyeon Kim, Chong You, Himanshu Jain, Andreas Veit, Rob Fergus, Sanjiv Kumar

ICLR 2023 The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers Zonglin Li, Chong You, Srinadh Bhojanapalli, Daliang Li, Ankit Singh Rawat, Sashank J. Reddi, Ke Ye, Felix Chern, Felix Yu, Ruiqi Guo, Sanjiv Kumar

NeurIPSW 2023 Think Before You Speak: Training Language Models with Pause Tokens Sachin Goyal, Ziwei Ji, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar, Vaishnavh Nagarajan

ICML 2022 In Defense of Dual-Encoders for Neural Ranking Aditya Menon, Sadeep Jayasumana, Ankit Singh Rawat, Seungyeon Kim, Sashank Reddi, Sanjiv Kumar

ICML 2021 A Statistical Perspective on Distillation Aditya K Menon, Ankit Singh Rawat, Sashank Reddi, Seungyeon Kim, Sanjiv Kumar

NeurIPSW 2021 An Empirical Study of Pre-Trained Vision Models on Out-of-Distribution Generalization Yaodong Yu, Heinrich Jiang, Dara Bahri, Hossein Mobahi, Seungyeon Kim, Ankit Singh Rawat, Andreas Veit, Yi Ma

ICML 2021 Disentangling Sampling and Labeling Bias for Learning in Large-Output Spaces Ankit Singh Rawat, Aditya K Menon, Wittawat Jitkrittum, Sadeep Jayasumana, Felix Yu, Sashank Reddi, Sanjiv Kumar

ICLR 2021 Long-Tail Learning via Logit Adjustment Aditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain, Andreas Veit, Sanjiv Kumar

ICLR 2021 Overparameterisation and Worst-Case Generalisation: Friend or Foe? Aditya Krishna Menon, Ankit Singh Rawat, Sanjiv Kumar

NeurIPS 2020 Adversarial Robustness via Robust Low Rank Representations Pranjal Awasthi, Himanshu Jain, Ankit Singh Rawat, Aravindan Vijayaraghavan

ICLR 2020 Are Transformers Universal Approximators of Sequence-to-Sequence Functions? Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

ICLR 2020 Can Gradient Clipping Mitigate Label Noise? Aditya Krishna Menon, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

ICML 2020 Federated Learning with Only Positive Labels Felix Yu, Ankit Singh Rawat, Aditya Menon, Sanjiv Kumar

ICML 2020 Low-Rank Bottleneck in Multi-Head Attention Models Srinadh Bhojanapalli, Chulhee Yun, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar

NeurIPS 2020 O(n) Connections Are Expressive Enough: Universal Approximability of Sparse Transformers Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar

NeurIPS 2020 Robust Large-Margin Learning in Hyperbolic Space Melanie Weber, Manzil Zaheer, Ankit Singh Rawat, Aditya K Menon, Sanjiv Kumar

NeurIPSW 2019 Learning Network Parameters in the ReLU Model Arya Mazumdar, Ankit Singh Rawat

AISTATS 2019 Lifting High-Dimensional Non-Linear Models with Gaussian Regressors Christos Thrampoulidis, Ankit Singh Rawat

NeurIPS 2019 Multilabel Reductions: What Is My Loss Optimising? Aditya K Menon, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar

NeurIPS 2019 Sampled SoftMax with Random Fourier Features Ankit Singh Rawat, Jiecao Chen, Felix Xinnan X Yu, Ananda Theertha Suresh, Sanjiv Kumar

AAAI 2017 Associative Memory Using Dictionary Learning and Expander Decoding Arya Mazumdar, Ankit Singh Rawat

NeurIPS 2015 Associative Memory via a Sparse Recovery Model Arya Mazumdar, Ankit Singh Rawat