Mirzadeh, Seyed Iman

14 publications

ICLR 2025 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models Seyed Iman Mirzadeh, Keivan Alizadeh, Hooman Shahrokhi, Oncel Tuzel, Samy Bengio, Mehrdad Farajtabar

NeurIPS 2025 The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity Parshin Shojaee, Seyed Iman Mirzadeh, Keivan Alizadeh, Maxwell Horton, Samy Bengio, Mehrdad Farajtabar

NeurIPSW 2024 Model Soup for Better RLHF: Weight Space Averaging to Improve Alignment in LLMs Atoosa Chegini, Hamid Kazemi, Seyed Iman Mirzadeh, Dong Yin, Maxwell Horton, Moin Nabi, Mehrdad Farajtabar, Keivan Alizadeh

ICMLW 2024 OpenELM: An Efficient Language Model Family with Open Training and Inference Framework Sachin Mehta, Mohammad Hossein Sekhavat, Qingqing Cao, Maxwell Horton, Yanzi Jin, Chenfan Sun, Seyed Iman Mirzadeh, Mahyar Najibi, Dmitry Belenko, Peter Zatloukal, Mohammad Rastegari

ICLR 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models Seyed Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

NeurIPSW 2024 TiC-LM: A Multi-Year Benchmark for Continual Pretraining of Language Models Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri

CoLLAs 2023 Continual Learning Beyond a Single Model Thang Doan, Seyed Iman Mirzadeh, Mehrdad Farajtabar

ICML 2022 Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin, Huiyi Hu, Razvan Pascanu, Dilan Gorur, Mehrdad Farajtabar

CVPRW 2021 CL-Gym: Full-Featured PyTorch Library for Continual Learning Seyed-Iman Mirzadeh, Hassan Ghasemzadeh

ICLR 2021 Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Gorur, Razvan Pascanu, Hassan Ghasemzadeh

CVPRW 2020 Dropout as an Implicit Gating Mechanism for Continual Learning Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Hassan Ghasemzadeh

AAAI 2020 Improved Knowledge Distillation via Teacher Assistant Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li, Nir Levine, Akihiro Matsukawa, Hassan Ghasemzadeh

IJCAI 2020 Optimal Policy for Deployment of Machine Learning Models on Energy-Bounded Systems Seyed-Iman Mirzadeh, Hassan Ghasemzadeh

NeurIPS 2020 Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan Ghasemzadeh