Morcos, Ari S.

19 publications

ICLR 2024 Effective Pruning of Web-Scale Datasets Based on Complexity of Concept Clusters Amro Kamal Mohamed Abbas, Evgenia Rusak, Kushal Tirumala, Wieland Brendel, Kamalika Chaudhuri, Ari S. Morcos
CVPR 2024 Sieve: Multimodal Dataset Pruning Using Image Captioning Models Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, Ari S. Morcos
ICLR 2023 Emergence of Maps in the Memories of Blind Navigation Agents Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra
TMLR 2023 Lo-Fi: Distributed Fine-Tuning Without Communication Mitchell Wortsman, Suchin Gururangan, Shen Li, Ali Farhadi, Ludwig Schmidt, Michael Rabbat, Ari S. Morcos
ICLRW 2023 Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations Shashank Shekhar, Florian Bordes, Pascal Vincent, Ari S. Morcos
TMLR 2023 On the Special Role of Class-Selective Neurons in Early Training Omkar Ranadive, Nikhil Thakurdesai, Ari S. Morcos, Matthew L Leavitt, Stephane Deny
ICLRW 2023 SemDeDup: Data-Efficient Learning at Web-Scale Through Semantic Deduplication Amro Kamal Mohamed Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, Ari S. Morcos
TMLR 2023 The Robustness Limits of SoTA Vision Models to Natural Variation Mark Ibrahim, Quentin Garrido, Ari S. Morcos, Diane Bouchacourt
ICML 2022 COAT: Measuring Object Compositionality in Emergent Representations Sirui Xie, Ari S Morcos, Song-Chun Zhu, Ramakrishna Vedantam
ICML 2022 Model Soups: Averaging Weights of Multiple Fine-Tuned Models Improves Accuracy Without Increasing Inference Time Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
ICML 2021 ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases Stéphane D’Ascoli, Hugo Touvron, Matthew L Leavitt, Ari S Morcos, Giulio Biroli, Levent Sagun
ECML-PKDD 2021 Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks Ting-Wu Chin, Ari S. Morcos, Diana Marculescu
NeurIPSW 2021 Learning Background Invariance Improves Generalization and Robustness in Self-Supervised Learning on ImageNet and Beyond Chaitanya Ryali, David J. Schwab, Ari S. Morcos
ICLR 2021 Selectivity Considered Harmful: Evaluating the Causal Impact of Class Selectivity in DNNs Matthew L Leavitt, Ari S. Morcos
ICLR 2021 Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs Jonathan Frankle, David J. Schwab, Ari S. Morcos
CVPRW 2021 Width Transfer: On the (In)variance of Width Optimization Ting-Wu Chin, Diana Marculescu, Ari S. Morcos
ICLR 2020 Playing the Lottery with Rewards and Multiple Languages: Lottery Tickets in RL and NLP Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
ICLR 2020 The Early Phase of Neural Network Training Jonathan Frankle, David J. Schwab, Ari S. Morcos
ICLR 2018 On the Importance of Single Directions for Generalization Ari S. Morcos, David G.T. Barrett, Neil C. Rabinowitz, Matthew Botvinick