Nagle, Alliot

8 publications

ICLR 2025 Attention with Markov: A Curious Case of Single-Layer Transformers Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar

ICMLW 2024 Attention with Markov: A Curious Case of Single-Layer Transformers Ashok Vardhan Makkuva, Marco Bondaschi, Alliot Nagle, Adway Girish, Hyeji Kim, Martin Jaggi, Michael Gastpar

NeurIPS 2024 Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models Alliot Nagle, Adway Girish, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva, Hyeji Kim

ICMLW 2024 Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models Adway Girish, Alliot Nagle, Ashok Vardhan Makkuva, Marco Bondaschi, Michael Gastpar, Hyeji Kim

NeurIPS 2024 Local to Global: Learning Dynamics and Effect of Initialization for Transformers Ashok Vardhan Makkuva, Marco Bondaschi, Chanakya Ekbote, Adway Girish, Alliot Nagle, Hyeji Kim, Michael Gastpar

ICMLW 2024 Local to Global: Learning Dynamics and Effect of Initialization for Transformers Ashok Vardhan Makkuva, Marco Bondaschi, Chanakya Ekbote, Adway Girish, Alliot Nagle, Hyeji Kim, Michael Gastpar

NeurIPS 2022 Rare Gems: Finding Lottery Tickets at Initialization Kartik Sreenivasan, Jy-yong Sohn, Liu Yang, Matthew Grinde, Alliot Nagle, Hongyi Wang, Eric P. Xing, Kangwook Lee, Dimitris Papailiopoulos

NeurIPS 2020 Optimal Lottery Tickets via Subset Sum: Logarithmic Over-Parameterization Is Sufficient Ankit Pensia, Shashank Rajput, Alliot Nagle, Harit Vishwakarma, Dimitris Papailiopoulos