Elhoushi, Mostafa

13 publications

ICML 2025 Any4: Learned 4-Bit Numeric Representation for LLMs Mostafa Elhoushi, Jeff Johnson

NeurIPS 2025 CATransformers: Carbon Aware Transformers Through Joint Model-Hardware Optimization Irene Wang, Mostafa Elhoushi, H Ekin Sumbul, Samuel Hsia, Daniel Jiang, Newsha Ardalani, Divya Mahajan, Carole-Jean Wu, Bilge Acun

TMLR 2025 Efficient Hardware Scaling and Diminishing Returns in Large-Scale Training of Language Models Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn

CVPRW 2025 PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers Maximilian Augustin, Syed Shakib Sarwar, Mostafa Elhoushi, Yuecheng Li, Sai Qian Zhang, Barbara De Salvo

ICML 2024 AST-T5: Structure-Aware Pretraining for Code Generation and Understanding Linyuan Gong, Mostafa Elhoushi, Alvin Cheung

ICML 2024 CHAI: Clustered Head Attention for Efficient LLM Inference Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu

ICML 2024 Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung

CVPR 2024 Sieve: Multimodal Dataset Pruning Using Image Captioning Models Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, Ari S. Morcos

ICML 2023 Learning Compiler Pass Orders Using Coreset and Normalized Value Prediction Youwei Liang, Kevin Stone, Ali Shameli, Chris Cummins, Mostafa Elhoushi, Jiadong Guo, Benoit Steiner, Xiaomeng Yang, Pengtao Xie, Hugh James Leather, Yuandong Tian

ICML 2023 MODeL: Memory Optimizations for Deep Learning Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty

CVPR 2022 Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy, Mostafa Elhoushi, Hong Zhang, Nilanjan Ray

CVPRW 2021 DeepShift: Towards Multiplication-Less Neural Networks Mostafa Elhoushi, Zihao Chen, Farhan Shafiq, Ye Henry Tian, Joey Yiwei Li

CVPRW 2021 Layer Importance Estimation with Imprinting for Neural Network Quantization Hongyang Liu, Sara Elkerdawy, Nilanjan Ray, Mostafa Elhoushi