Sanghai, Sumit

3 publications

ICLR 2024 Functional Interpolation for Relative Positions Improves Long Context Transformers Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontanon, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli

ICML 2023 Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models Luke Vilnis, Yury Zemlyanskiy, Patrick Murray, Alexandre Tachard Passos, Sumit Sanghai

ICML 2023 Pre-Computed Memory or On-the-Fly Encoding? a Hybrid Approach to Retrieval Augmentation Makes the Most of Your Compute Michiel De Jong, Yury Zemlyanskiy, Nicholas Fitzgerald, Joshua Ainslie, Sumit Sanghai, Fei Sha, William W. Cohen