Rastegari, Mohammad

41 publications

ICLRW 2025 KV Prediction for Improved Time to First Token Maxwell Horton, Qingqing Cao, Chenfan Sun, Yanzi Jin, Sachin Mehta, Mohammad Rastegari, Moin Nabi

ICLR 2025 SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators Rasoul Shafipour, David Harrison, Maxwell Horton, Jeffrey Marker, Houman Bedayat, Sachin Mehta, Mohammad Rastegari, Mahyar Najibi, Saman Naderiparizi

TMLR 2024 Bytes Are All You Need: Transformers Operating Directly on File Bytes Maxwell Horton, Sachin Mehta, Ali Farhadi, Mohammad Rastegari

TMLR 2024 CLIP Meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta

ICML 2024 KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation Minsik Cho, Mohammad Rastegari, Devang Naik

ICML 2024 Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-Specific Models Raviteja Vemulapalli, Hadi Pouransari, Fartash Faghri, Sachin Mehta, Mehrdad Farajtabar, Mohammad Rastegari, Oncel Tuzel

ICMLW 2024 LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference Qichen Fu, Minsik Cho, Thomas Merth, Sachin Mehta, Mohammad Rastegari, Mahyar Najibi

ICMLW 2024 OpenELM: An Efficient Language Model Family with Open Training and Inference Framework Sachin Mehta, Mohammad Hossein Sekhavat, Qingqing Cao, Maxwell Horton, Yanzi Jin, Chenfan Sun, Seyed Iman Mirzadeh, Mahyar Najibi, Dmitry Belenko, Peter Zatloukal, Mohammad Rastegari

ICLR 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models Seyed Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

CVPRW 2024 SAM-CLIP: Merging Vision Foundation Models Towards Semantic and Spatial Understanding Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari

NeurIPSW 2024 Simple LLM Compression Recovery Using Dynamic Prompting with Theoretical Analysis Duc N.M Hoang, Minsik Cho, Thomas Merth, Mohammad Rastegari, Zhangyang Wang

ICML 2024 Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation Thomas Merth, Qichen Fu, Mohammad Rastegari, Mahyar Najibi

NeurIPSW 2023 CLIP Meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta

WACV 2023 LCS: Learning Compressible Subspaces for Efficient, Adaptive, Real-Time Network Compression at Inference Time Elvis Nunez, Maxwell Horton, Anish Prabhu, Anurag Ranjan, Ali Farhadi, Mohammad Rastegari

ICCV 2023 Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement Fartash Faghri, Hadi Pouransari, Sachin Mehta, Mehrdad Farajtabar, Ali Farhadi, Mohammad Rastegari, Oncel Tuzel

NeurIPSW 2023 SAM-CLIP: Merging Vision Foundation Models Towards Semantic and Spatial Understanding Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari

TMLR 2023 Separable Self-Attention for Mobile Vision Transformers Sachin Mehta, Mohammad Rastegari

WACV 2023 Token Pooling in Vision Transformers for Image Classification Dmitrii Marin, Jen-Hao Rick Chang, Anurag Ranjan, Anish Prabhu, Mohammad Rastegari, Oncel Tuzel

ICLR 2022 DKM: Differentiable K-Means Clustering Layer for Neural Network Compression Minsik Cho, Keivan Alizadeh-Vahid, Saurabh Adya, Mohammad Rastegari

ICLR 2022 MobileViT: Light-Weight, General-Purpose, and Mobile-Friendly Vision Transformer Sachin Mehta, Mohammad Rastegari

ECCV 2022 SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks Chien-Yu Lin, Anish Prabhu, Thomas Merth, Sachin Mehta, Anurag Ranjan, Maxwell Horton, Mohammad Rastegari

ICML 2021 Learning Neural Network Subspaces Mitchell Wortsman, Maxwell C Horton, Carlos Guestrin, Ali Farhadi, Mohammad Rastegari

ICLR 2020 DeFINE: DEep Factorized INput Token Embeddings for Neural Sequence Modeling Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi

NeurIPS 2020 Supermasks in Superposition Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, Ali Farhadi

NeurIPS 2019 Discovering Neural Wirings Mitchell Wortsman, Ali Farhadi, Mohammad Rastegari

ECCV 2018 ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation Sachin Mehta, Mohammad Rastegari, Anat Caspi, Linda Shapiro, Hannaneh Hajishirzi

CVPR 2017 LCNN: Lookup-Based Convolutional Neural Network Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi

ECCV 2016 "What Happens If..." Learning to Predict the Effect of Forces in Images Roozbeh Mottaghi, Mohammad Rastegari, Abhinav Gupta, Ali Farhadi

CVPR 2016 G-CNN: An Iterative Grid Based Object Detector Mahyar Najibi, Mohammad Rastegari, Larry S. Davis

CVPR 2016 Newtonian Scene Understanding: Unfolding the Dynamics of Objects in Static Images Roozbeh Mottaghi, Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi

ECCV 2016 XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi

CVPR 2015 Class Consistent Multi-Modal Fusion with Binary Features Ashish Shrivastava, Mohammad Rastegari, Sumit Shekhar, Rama Chellappa, Larry S. Davis

CVPR 2015 Computationally Bounded Retrieval Mohammad Rastegari, Cem Keskin, Pushmeet Kohli, Shahram Izadi

CVPR 2015 Discriminative and Consistent Similarities in Instance-Level Multiple Instance Learning Mohammad Rastegari, Hannaneh Hajishirzi, Ali Farhadi

CVPR 2013 Adding Unlabeled Samples to Categories by Learned Attributes Jonghyun Choi, Mohammad Rastegari, Ali Farhadi, Larry S. Davis

ICCV 2013 Domain Adaptive Classification Fatemeh Mirrashed, Mohammad Rastegari

CVPR 2013 Multi-Attribute Queries: To Merge or Not to Merge? Mohammad Rastegari, Ali Diba, Devi Parikh, Ali Farhadi

ICML 2013 Predictable Dual-View Hashing Mohammad Rastegari, Jonghyun Choi, Shobeir Fakhraei, Daume Hal, Larry Davis

ECCV 2012 Attribute Discovery via Predictable Discriminative Binary Codes Mohammad Rastegari, Ali Farhadi, David A. Forsyth

UAI 2012 Semantic Understanding of Professional Soccer Commentaries Hannaneh Hajishirzi, Mohammad Rastegari, Ali Farhadi, Jessica K. Hodgins

ICCV 2011 Scalable Object-Class Retrieval with Approximate and Top-K Ranking Mohammad Rastegari, Chen Fang, Lorenzo Torresani