Houlsby, Neil

44 publications

ICLR 2024 From Sparse to Soft Mixtures of Experts Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby

CVPR 2024 Frozen Feature Augmentation for Few-Shot Image Classification Andreas Bär, Neil Houlsby, Mostafa Dehghani, Manoj Kumar

WACV 2024 Location-Aware Self-Supervised Transformers for Semantic Segmentation Mathilde Caron, Neil Houlsby, Cordelia Schmid

CVPR 2024 On Scaling up a Multilingual Vision and Language Model Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, Aj Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut

ICLR 2024 Scaling Laws for Sparsely-Connected Foundation Models Elias Frantar, Carlos Riquelme Ruiz, Neil Houlsby, Dan Alistarh, Utku Evci

NeurIPS 2024 SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation Jonathan Roberts, Kai Han, Neil Houlsby, Samuel Albanie

ICML 2023 Adaptive Computation with Elastic Input Sequence Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You

CVPR 2023 CLIPPO: Image-and-Language Understanding from Pixels Only Michael Tschannen, Basil Mustafa, Neil Houlsby

TMLR 2023 Dual PatchNorm Manoj Kumar, Mostafa Dehghani, Neil Houlsby

NeurIPS 2023 Image Captioners Are Scalable Vision Learners Too Michael Tschannen, Manoj Kumar, Andreas Steiner, Xiaohua Zhai, Neil Houlsby, Lucas Beyer

ICLR 2023 Massively Scaling Heteroscedastic Classifiers Mark Collier, Rodolphe Jenatton, Basil Mustafa, Neil Houlsby, Jesse Berent, Effrosyni Kokiopoulou

ICLR 2023 PaLI: A Jointly-Scaled Multilingual Language-Image Model Xi Chen, Xiao Wang, Soravit Changpinyo, Aj Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V Thapliyal, James Bradbury, Weicheng Kuo, Mojtaba Seyedhosseini, Chao Jia, Burcu Karagol Ayan, Carlos Riquelme Ruiz, Andreas Peter Steiner, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut

NeurIPS 2023 Patch N’ Pack: NaViT, a Vision Transformer for Any Aspect Ratio and Resolution Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim M Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey Gritsenko, Mario Lucic, Neil Houlsby

NeurIPS 2023 Scaling Open-Vocabulary Object Detection Matthias Minderer, Alexey Gritsenko, Neil Houlsby

ICML 2023 Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd Van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby

ICLR 2023 Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby

ICLR 2023 UL2: Unifying Language Learning Paradigms Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler

TMLR 2022 Do Better ImageNet Classifiers Assess Perceptual Similarity Better? Manoj Kumar, Neil Houlsby, Nal Kalchbrenner, Ekin Dogus Cubuk

NeurIPS 2022 Multimodal Contrastive Learning with LIMoE: The Language-Image Mixture of Experts Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby

ICMLW 2022 SI-Score: An Image Dataset for Fine-Grained Analysis of Robustness to Object Location, Rotation and Size Jessica Yung, Rob Romijnders, Alexander Kolesnikov, Lucas Beyer, Josip Djolonga, Neil Houlsby, Sylvain Gelly, Mario Lucic, Xiaohua Zhai

CVPR 2022 Scaling Vision Transformers Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer

ECCV 2022 Simple Open-Vocabulary Object Detection with Vision Transformers Matthias Minderer, Alexey Gritsenko, Austin Stone, Maxim Neumann, Dirk Weissenborn, Alexey Dosovitskiy, Aravindh Mahendran, Anurag Arnab, Mostafa Dehghani, Zhuoran Shen, Xiao Wang, Xiaohua Zhai, Thomas Kipf, Neil Houlsby

TMLR 2022 Sparse MoEs Meet Efficient Ensembles James Urquhart Allingham, Florian Wenzel, Zelda E Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton

NeurIPS 2022 UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes Alexander Kolesnikov, André Susano Pinto, Lucas Beyer, Xiaohua Zhai, Jeremiah Harmsen, Neil Houlsby

JMLR 2022 Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander D'Amour, Katherine Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Jacob Eisenstein, Matthew D. Hoffman, Farhad Hormozdiari, Neil Houlsby, Shaobo Hou, Ghassen Jerfel, Alan Karthikesalingam, Mario Lucic, Yian Ma, Cory McLean, Diana Mincu, Akinori Mitani, Andrea Montanari, Zachary Nado, Vivek Natarajan, Christopher Nielson, Thomas F. Osborne, Rajiv Raman, Kim Ramasamy, Rory Sayres, Jessica Schrouff, Martin Seneviratne, Shannon Sequeira, Harini Suresh, Victor Veitch, Max Vladymyrov, Xuezhi Wang, Kellie Webster, Steve Yadlowsky, Taedong Yun, Xiaohua Zhai, D. Sculley

ICLR 2021 An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby

NeurIPS 2021 MLP-Mixer: An All-MLP Architecture for Vision Ilya O Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, Mario Lucic, Alexey Dosovitskiy

CVPR 2021 On Robustness and Transferability of Convolutional Neural Networks Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic

WACV 2021 Representation Learning from Videos In-the-Wild: An Object-Centric Approach Rob Romijnders, Aravindh Mahendran, Michael Tschannen, Josip Djolonga, Marvin Ritter, Neil Houlsby, Mario Lucic

NeurIPS 2021 Revisiting the Calibration of Modern Neural Networks Matthias Minderer, Josip Djolonga, Rob Romijnders, Frances Hubis, Xiaohua Zhai, Neil Houlsby, Dustin Tran, Mario Lucic

ICLR 2021 Scalable Transfer Learning with Expert Models Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Cedric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby

NeurIPS 2021 Scaling Vision with Sparse Mixture of Experts Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby

ICML 2020 Automatic Shortcut Removal for Self-Supervised Representation Learning Matthias Minderer, Olivier Bachem, Neil Houlsby, Michael Tschannen

ECCV 2020 Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby

ICLR 2019 On Self Modulation for Generative Adversarial Networks Ting Chen, Mario Lucic, Neil Houlsby, Sylvain Gelly

ICML 2019 Parameter-Efficient Transfer Learning for NLP Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain Gelly

ICLR 2018 Ask the Right Questions: Active Question Reformulation with Reinforcement Learning Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby, Wei Wang.

NeurIPS 2018 Transfer Learning with Neural AutoML Catherine Wong, Neil Houlsby, Yifeng Lu, Andrea Gesmundo

NeurIPS 2014 A Filtering Approach to Stochastic Variational Inference Neil Houlsby, David Blei

ICML 2014 Cold-Start Active Learning with Robust Ordinal Matrix Factorization Neil Houlsby, Jose Miguel Hernandez-Lobato, Zoubin Ghahramani

ICML 2014 Probabilistic Matrix Factorization with Non-Random Missing Data Jose Miguel Hernandez-Lobato, Neil Houlsby, Zoubin Ghahramani

ICML 2014 Stochastic Inference for Scalable Probabilistic Modeling of Binary Matrices Jose Miguel Hernandez-Lobato, Neil Houlsby, Zoubin Ghahramani

AISTATS 2013 Active Learning for Interactive Visualization Tomoharu Iwata, Neil Houlsby, Zoubin Ghahramani

NeurIPS 2012 Collaborative Gaussian Processes for Preference Learning Neil Houlsby, Ferenc Huszar, Zoubin Ghahramani, Jose M. Hernández-lobato