Gupta, Abhay

5 publications

ICML 2025 $\mathrmμ$nit Scaling: Simple and Scalable FP8 LLM Training Saaketh Narayan, Abhay Gupta, Mansheej Paul, Davis Blalock
ICLRW 2025 Endive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models Abhay Gupta, Jacob Cheung, Philip Meng, Shayan Sayyed, Austen Liao, Kevin Zhu, Sean O'Brien
ICML 2024 Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa, Shreyas Saxena, Abhay Gupta, Sean Lie
UAI 2023 SPDF: Sparse Pre-Training and Dense Fine-Tuning for Large Language Models Vithursan Thangarasa, Abhay Gupta, William Marshall, Tianda Li, Kevin Leong, Dennis DeCoste, Sean Lie, Shreyas Saxena
NeurIPSW 2023 Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa, Shreyas Saxena, Abhay Gupta, Sean Lie