Gomez, Aidan N.

8 publications

JMLR 2022 Interlocking Backpropagation: Improving Depthwise Model-Parallelism Aidan N. Gomez, Oscar Key, Kuba Perlin, Stephen Gou, Nick Frosst, Jeff Dean, Yarin Gal

ICML 2022 Prioritized Training on Points That Are Learnable, Worth Learning, and Not yet Learnt Sören Mindermann, Jan M Brauner, Muhammed T Razzak, Mrinank Sharma, Andreas Kirsch, Winnie Xu, Benedikt Höltgen, Aidan N Gomez, Adrien Morisot, Sebastian Farquhar, Yarin Gal

ICML 2022 Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-Time Retrieval Pascal Notin, Mafalda Dias, Jonathan Frazer, Javier Marchena-Hurtado, Aidan N Gomez, Debora Marks, Yarin Gal

NeurIPS 2021 Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning Jannik Kossen, Neil Band, Clare Lyle, Aidan N Gomez, Thomas Rainforth, Yarin Gal

ICLR 2018 Depthwise Separable Convolutions for Neural Machine Translation Lukasz Kaiser, Aidan N. Gomez, Francois Chollet

ICLR 2018 Unsupervised Cipher Cracking Using Discrete GANs Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, Lukasz Kaiser

NeurIPS 2017 Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin

NeurIPS 2017 The Reversible Residual Network: Backpropagation Without Storing Activations Aidan N Gomez, Mengye Ren, Raquel Urtasun, Roger B Grosse