Mozaffari, Mohammad

3 publications

ICML 2025 SLiM: One-Shot Quantization and Sparsity with Low-Rank Approximation for LLM Weight Compression Mohammad Mozaffari, Amir Yazdanbakhsh, Maryam Mehri Dehnavi

ICLR 2025 SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs Mohammad Mozaffari, Amir Yazdanbakhsh, Zhao Zhang, Maryam Mehri Dehnavi

NeurIPS 2023 MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates Mohammad Mozaffari, Sikan Li, Zhao Zhang, Maryam Mehri Dehnavi