Naik, Devang

5 publications

ICLRW 2025 From Dense to Dynamic: Token-Difficulty Driven MoEfication of Pre-Trained LLMs Kumari Nishu, Sachin Mehta, Samira Abnar, Mehrdad Farajtabar, Maxwell Horton, Mahyar Najibi, Moin Nabi, Minsik Cho, Devang Naik

ICLRW 2025 M2R2: Efficient Transformers with Mixture of Multi-Rate Residuals Nikhil Bhendawade, Mahyar Najibi, Devang Naik, Irina Belousova

ICML 2024 KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation Minsik Cho, Mohammad Rastegari, Devang Naik

NeurIPS 2023 PDP: Parameter-Free Differentiable Pruning Is All You Need Minsik Cho, Saurabh Adya, Devang Naik

ICMLW 2023 PDP: Parameter-Free Differentiable Pruning Is All You Need Minsik Cho, Saurabh Adya, Devang Naik