Farajtabar, Mehrdad

43 publications

ICLRW 2025 From Dense to Dynamic: Token-Difficulty Driven MoEfication of Pre-Trained LLMs Kumari Nishu, Sachin Mehta, Samira Abnar, Mehrdad Farajtabar, Maxwell Horton, Mahyar Najibi, Moin Nabi, Minsik Cho, Devang Naik

ICLR 2025 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models Seyed Iman Mirzadeh, Keivan Alizadeh, Hooman Shahrokhi, Oncel Tuzel, Samy Bengio, Mehrdad Farajtabar

ICML 2025 Proxy-FDA: Proxy-Based Feature Distribution Alignment for Fine-Tuning Vision Foundation Models Without Forgetting Chen Huang, Skyler Seto, Hadi Pouransari, Mehrdad Farajtabar, Raviteja Vemulapalli, Fartash Faghri, Oncel Tuzel, Barry-John Theobald, Joshua M. Susskind

NeurIPS 2025 The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity Parshin Shojaee, Seyed Iman Mirzadeh, Keivan Alizadeh, Maxwell Horton, Samy Bengio, Mehrdad Farajtabar

TMLR 2024 CLIP Meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta

ICML 2024 Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-Specific Models Raviteja Vemulapalli, Hadi Pouransari, Fartash Faghri, Sachin Mehta, Mehrdad Farajtabar, Mohammad Rastegari, Oncel Tuzel

NeurIPSW 2024 Model Soup for Better RLHF: Weight Space Averaging to Improve Alignment in LLMs Atoosa Chegini, Hamid Kazemi, Seyed Iman Mirzadeh, Dong Yin, Maxwell Horton, Moin Nabi, Mehrdad Farajtabar, Keivan Alizadeh

ICLR 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models Seyed Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

CVPRW 2024 SAM-CLIP: Merging Vision Foundation Models Towards Semantic and Spatial Understanding Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari

ICLR 2024 TiC-CLIP: Continual Training of CLIP Models Saurabh Garg, Mehrdad Farajtabar, Hadi Pouransari, Raviteja Vemulapalli, Sachin Mehta, Oncel Tuzel, Vaishaal Shankar, Fartash Faghri

NeurIPSW 2024 TiC-LM: A Multi-Year Benchmark for Continual Pretraining of Language Models Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri

NeurIPSW 2023 CLIP Meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta

CoLLAs 2023 Continual Learning Beyond a Single Model Thang Doan, Seyed Iman Mirzadeh, Mehrdad Farajtabar

ICCV 2023 Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement Fartash Faghri, Hadi Pouransari, Sachin Mehta, Mehrdad Farajtabar, Ali Farhadi, Mohammad Rastegari, Oncel Tuzel

NeurIPSW 2023 SAM-CLIP: Merging Vision Foundation Models Towards Semantic and Spatial Understanding Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari

NeurIPSW 2023 TiC-CLIP: Continual Training of CLIP Models Saurabh Garg, Mehrdad Farajtabar, Hadi Pouransari, Raviteja Vemulapalli, Sachin Mehta, Oncel Tuzel, Vaishaal Shankar, Fartash Faghri

TMLR 2022 An Empirical Study of Implicit Regularization in Deep Offline RL Caglar Gulcehre, Srivatsan Srinivasan, Jakub Sygnowski, Georg Ostrovski, Mehrdad Farajtabar, Matthew Hoffman, Razvan Pascanu, Arnaud Doucet

ICML 2022 Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin, Huiyi Hu, Razvan Pascanu, Dilan Gorur, Mehrdad Farajtabar

ICLR 2021 Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Gorur, Razvan Pascanu, Hassan Ghasemzadeh

ICMLW 2021 Task-Agnostic Continual Learning with Hybrid Probabilistic Models Polina Kirichenko, Mehrdad Farajtabar, Dushyant Rao, Balaji Lakshminarayanan, Nir Levine, Ang Li, Huiyi Hu, Andrew Gordon Wilson, Razvan Pascanu

NeurIPS 2020 A Maximum-Entropy Approach to Off-Policy Evaluation in Average-Reward MDPs Nevena Lazic, Dong Yin, Mehrdad Farajtabar, Nir Levine, Dilan Gorur, Chris Harris, Dale Schuurmans

CVPRW 2020 Dropout as an Implicit Gating Mechanism for Continual Learning Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Hassan Ghasemzadeh

AAAI 2020 Improved Knowledge Distillation via Teacher Assistant Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li, Nir Levine, Akihiro Matsukawa, Hassan Ghasemzadeh

NeurIPS 2020 Learning to Incentivize Other Learning Agents Jiachen Yang, Ang Li, Mehrdad Farajtabar, Peter Sunehag, Edward Hughes, Hongyuan Zha

AISTATS 2020 Orthogonal Gradient Descent for Continual Learning Mehrdad Farajtabar, Navid Azizan, Alex Mott, Ang Li

NeurIPS 2020 Self-Distillation Amplifies Regularization in Hilbert Space Hossein Mobahi, Mehrdad Farajtabar, Peter L. Bartlett

NeurIPS 2020 Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan Ghasemzadeh

ICLR 2019 DyRep: Learning Representations over Dynamic Graphs Rakshit Trivedi, Mehrdad Farajtabar, Prasenjeet Biswal, Hongyuan Zha

IJCAI 2018 Discrete Interventions in Hawkes Processes with Applications in Invasive Species Management Amrita Gupta, Mehrdad Farajtabar, Bistra Dilkina, Hongyuan Zha

AAAI 2018 Learning Conditional Generative Models for Temporal Point Processes Shuai Xiao, Hongteng Xu, Junchi Yan, Mehrdad Farajtabar, Xiaokang Yang, Le Song, Hongyuan Zha

ICML 2018 More Robust Doubly Robust Off-Policy Evaluation Mehrdad Farajtabar, Yinlam Chow, Mohammad Ghavamzadeh

JMLR 2017 COEVOLVE: A Joint Point Process Model for Information Diffusion and Network Evolution Mehrdad Farajtabar, Yichen Wang, Manuel Gomez-Rodriguez, Shuang Li, Hongyuan Zha, Le Song

AAAI 2017 Correlated Cascades: Compete or Cooperate Ali Zarezade, Ali Khodadadi, Mehrdad Farajtabar, Hamid R. Rabiee, Hongyuan Zha

ICML 2017 Fake News Mitigation via Point Process Based Intervention Mehrdad Farajtabar, Jiachen Yang, Xiaojing Ye, Huan Xu, Rakshit Trivedi, Elias Khalil, Shuang Li, Le Song, Hongyuan Zha

NeurIPS 2017 Wasserstein Learning of Deep Generative Point Process Models Shuai Xiao, Mehrdad Farajtabar, Xiaojing Ye, Junchi Yan, Le Song, Hongyuan Zha

ICML 2016 Learning Granger Causality for Hawkes Processes Hongteng Xu, Mehrdad Farajtabar, Hongyuan Zha

NeurIPS 2016 Multistage Campaigning in Social Networks Mehrdad Farajtabar, Xiaojing Ye, Sahar Harati, Le Song, Hongyuan Zha

AISTATS 2015 Back to the past: Source Identification in Diffusion Networks from Partially Observed Cascades Mehrdad Farajtabar, Manuel Gomez-Rodriguez, Mohammad Zamani, Nan Du, Hongyuan Zha, Le Song

NeurIPS 2015 COEVOLVE: A Joint Point Process Model for Information Diffusion and Network Co-Evolution Mehrdad Farajtabar, Yichen Wang, Manuel Gomez Rodriguez, Shuang Li, Hongyuan Zha, Le Song

UAI 2015 Learning Latent Variable Models by Improving Spectral Solutions with Exterior Point Method Amirreza Shaban, Mehrdad Farajtabar, Bo Xie, Le Song, Byron Boots

NeurIPS 2014 Shaping Social Activity by Incentivizing Users Mehrdad Farajtabar, Nan Du, Manuel Gomez Rodriguez, Isabel Valera, Hongyuan Zha, Le Song

CVPR 2013 From Local Similarity to Global Coding: An Application to Image Classification Amirreza Shaban, Hamid R. Rabiee, Mehrdad Farajtabar, Marjan Ghazvininejad

ECML-PKDD 2011 Manifold Coarse Graining for Online Semi-Supervised Learning Mehrdad Farajtabar, Amirreza Shaban, Hamidreza Rabiee, Mohammad H. Rohban