Vinyals, Oriol

71 publications

NeurIPSW 2024 A Practitioner's Guide to Continual Multimodal Pretraining Karsten Roth, Vishaal Udandarao, Sebastian Dziadzio, Ameya Prabhu, Mehdi Cherti, Oriol Vinyals, Olivier J Henaff, Samuel Albanie, Matthias Bethge, Zeynep Akata

NeurIPS 2024 A Practitioner's Guide to Real-World Continual Multimodal Pretraining Vishaal Udandarao, Karsten Roth, Sebastian Dziadzio, Ameya Prabhu, Mehdi Cherti, Oriol Vinyals, Olivier Hénaff, Samuel Albanie, Zeynep Akata, Matthias Bethge

ICLR 2024 Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer Between Any Pretrained Model Karsten Roth, Lukas Thede, A. Sophia Koepke, Oriol Vinyals, Olivier J Henaff, Zeynep Akata

ICCV 2023 Waffling Around for Performance: Visual Classification with Random Words and Broad Concepts Karsten Roth, Jae Myung Kim, A. Sophia Koepke, Oriol Vinyals, Cordelia Schmid, Zeynep Akata

TMLR 2022 A Generalist Agent Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gómez Colmenarejo, Alexander Novikov, Gabriel Barth-maron, Mai Giménez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, Nando de Freitas

NeurIPS 2022 An Empirical Analysis of Compute-Optimal Large Language Model Training Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Thomas Hennigan, Eric Noland, Katherine Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karén Simonyan, Erich Elsen, Oriol Vinyals, Jack Rae, Laurent Sifre

TMLR 2022 Emergent Abilities of Large Language Models Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus

NeurIPS 2022 Flamingo: A Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob L Menick, Sebastian Borgeaud, Andy Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikołaj Bińkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karén Simonyan

ICML 2022 General-Purpose, Long-Context Autoregressive Modeling with Perceiver AR Curtis Hawthorne, Andrew Jaegle, Cătălina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, Joao Carreira, Jesse Engel

ICML 2022 Improving Language Models by Retrieving from Trillions of Tokens Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George Bm Van Den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego De Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack Rae, Erich Elsen, Laurent Sifre

CVPR 2022 Integrating Language Guidance into Vision-Based Deep Metric Learning Karsten Roth, Oriol Vinyals, Zeynep Akata

CVPR 2022 Non-Isotropy Regularization for Proxy-Based Deep Metric Learning Karsten Roth, Oriol Vinyals, Zeynep Akata

ICLR 2022 Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J Henaff, Matthew Botvinick, Andrew Zisserman, Oriol Vinyals, Joao Carreira

ICML 2022 Unified Scaling Laws for Routed Language Models Aidan Clark, Diego De Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake Hechtman, Trevor Cai, Sebastian Borgeaud, George Bm Van Den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc’Aurelio Ranzato, Jack Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan

ICCV 2021 Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aaron van den Oord, Oriol Vinyals, João Carreira

NeurIPS 2021 Multimodal Few-Shot Learning with Frozen Language Models Maria Tsimpoukelli, Jacob L Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill

ICML 2021 Perceiver: General Perception with Iterative Attention Andrew Jaegle, Felix Gimeno, Andy Brock, Oriol Vinyals, Andrew Zisserman, Joao Carreira

NeurIPSW 2021 StarCraft II Unplugged: Large Scale Offline Reinforcement Learning Michael Mathieu, Sherjil Ozair, Srivatsan Srinivasan, Caglar Gulcehre, Shangtong Zhang, Ray Jiang, Tom Le Paine, Konrad Zolna, Richard Powell, Julian Schrittwieser, David Choi, Petko Georgiev, Daniel Kenji Toyama, Aja Huang, Roman Ring, Igor Babuschkin, Timo Ewalds, Mahyar Bordbar, Sarah Henderson, Sergio Gómez Colmenarejo, Aaron van den Oord, Wojciech M. Czarnecki, Nando de Freitas, Oriol Vinyals

ICML 2021 Vector Quantized Models for Planning Sherjil Ozair, Yazhe Li, Ali Razavi, Ioannis Antonoglou, Aaron Van Den Oord, Oriol Vinyals

NeurIPS 2020 Pointer Graph Networks Petar Veličković, Lars Buesing, Matthew Overlan, Razvan Pascanu, Oriol Vinyals, Charles Blundell

ICLR 2020 Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol Vinyals

ICLR 2020 Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs Aditya Paliwal, Felix Gimeno, Vinod Nair, Yujia Li, Miles Lubin, Pushmeet Kohli, Oriol Vinyals

ICLR 2019 Attentive Neural Processes Hyunjik Kim, Andriy Mnih, Jonathan Schwarz, Marta Garnelo, Ali Eslami, Dan Rosenbaum, Oriol Vinyals, Yee Whye Teh

NeurIPS 2019 Classification Accuracy Score for Conditional Generative Models Suman Ravuri, Oriol Vinyals

ICLR 2019 Deep Reinforcement Learning with Relational Inductive Biases Vinicius Zambaldi, David Raposo, Adam Santoro, Victor Bapst, Yujia Li, Igor Babuschkin, Karl Tuyls, David Reichert, Timothy Lillicrap, Edward Lockhart, Murray Shanahan, Victoria Langston, Razvan Pascanu, Matthew Botvinick, Oriol Vinyals, Peter Battaglia

NeurIPS 2019 Generating Diverse High-Fidelity Images with VQ-VAE-2 Ali Razavi, Aaron van den Oord, Oriol Vinyals

ICLRW 2019 Generating Diverse High-Resolution Images with VQ-VAE Ali Razavi, Aaron van den Oord, Oriol Vinyals

ICML 2019 Graph Matching Networks for Learning the Similarity of Graph Structured Objects Yujia Li, Chenjie Gu, Thomas Dullien, Oriol Vinyals, Pushmeet Kohli

ICLR 2019 Meta-Learning with Latent Embedding Optimization Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero, Raia Hadsell

ICLR 2019 Preventing Posterior Collapse with Delta-VAEs Ali Razavi, Aaron van den Oord, Ben Poole, Oriol Vinyals

ICLR 2019 Sample Efficient Adaptive Text-to-Speech Yutian Chen, Yannis Assael, Brendan Shillingford, David Budden, Scott Reed, Heiga Zen, Quan Wang, Luis C. Cobo, Andrew Trask, Ben Laurie, Caglar Gulcehre, Aäron van den Oord, Oriol Vinyals, Nando de Freitas

ICLRW 2019 Seeing Is Not Necessarily Believing: Limitations of BigGANs for Data Augmentation Suman Ravuri, Oriol Vinyals

ICLR 2019 Universal Transformers Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, Lukasz Kaiser

ICLR 2018 Few-Shot Autoregressive Density Estimation: Towards Learning to Learn Distributions Scott Reed, Yutian Chen, Thomas Paine, Aäron van den Oord, S. M. Ali Eslami, Danilo Rezende, Oriol Vinyals, Nando de Freitas

ICLR 2018 Hierarchical Representations for Efficient Architecture Search Hanxiao Liu, Karen Simonyan, Oriol Vinyals, Chrisantha Fernando, Koray Kavukcuoglu

UAI 2018 Learning Fast Optimizers for Contextual Stochastic Integer Programs Vinod Nair, Dj Dvijotham, Iain Dunning, Oriol Vinyals

ICML 2018 Learning Implicit Generative Models with the Method of Learned Moments Suman Ravuri, Shakir Mohamed, Mihaela Rosca, Oriol Vinyals

ICML 2018 Learning to Search with MCTSnets Arthur Guez, Theophane Weber, Ioannis Antonoglou, Karen Simonyan, Oriol Vinyals, Daan Wierstra, Remi Munos, David Silver

ICLR 2018 Memory-Based Parameter Adaptation Pablo Sprechmann, Siddhant M. Jayakumar, Jack W. Rae, Alexander Pritzel, Adria Puigdomenech Badia, Benigno Uria, Oriol Vinyals, Demis Hassabis, Razvan Pascanu, Charles Blundell

ICML 2018 Parallel WaveNet: Fast High-Fidelity Speech Synthesis Aaron Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George Driessche, Edward Lockhart, Luis Cobo, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alex Graves, Helen King, Tom Walters, Dan Belov, Demis Hassabis

NeurIPS 2018 Relational Recurrent Neural Networks Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, Timothy Lillicrap

ICML 2018 Synthesizing Programs for Images Using Reinforced Adversarial Learning Yaroslav Ganin, Tejas Kulkarni, Igor Babuschkin, S. M. Ali Eslami, Oriol Vinyals

ICML 2017 Decoupled Neural Interfaces Using Synthetic Gradients Max Jaderberg, Wojciech Marian Czarnecki, Simon Osindero, Oriol Vinyals, Alex Graves, David Silver, Koray Kavukcuoglu

NeurIPS 2017 Imagination-Augmented Agents for Deep Reinforcement Learning Sébastien Racanière, Theophane Weber, David Reichert, Lars Buesing, Arthur Guez, Danilo Jimenez Rezende, Adrià Puigdomènech Badia, Oriol Vinyals, Nicolas Heess, Yujia Li, Razvan Pascanu, Peter Battaglia, Demis Hassabis, David Silver, Daan Wierstra

CVPR 2017 Lip Reading Sentences in the Wild Joon Son Chung, Andrew Senior, Oriol Vinyals, Andrew Zisserman

ICLR 2017 Metacontrol for Adaptive Imagination-Based Optimization Jessica B. Hamrick, Andrew J. Ballard, Razvan Pascanu, Oriol Vinyals, Nicolas Heess, Peter W. Battaglia

NeurIPS 2017 Neural Discrete Representation Learning Aaron van den Oord, Oriol Vinyals, Koray Kavukcuoglu

ICML 2017 Neural Episodic Control Alexander Pritzel, Benigno Uria, Sriram Srinivasan, Adrià Puigdomènech Badia, Oriol Vinyals, Demis Hassabis, Daan Wierstra, Charles Blundell

ICML 2017 Neural Message Passing for Quantum Chemistry Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

ICLR 2017 Understanding Deep Learning Requires Rethinking Generalization Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals

ICML 2017 Understanding Synthetic Gradients and Decoupled Neural Interfaces Wojciech Marian Czarnecki, Grzegorz Świrszcz, Max Jaderberg, Simon Osindero, Oriol Vinyals, Koray Kavukcuoglu

ICML 2017 Video Pixel Networks Nal Kalchbrenner, Aäron Oord, Karen Simonyan, Ivo Danihelka, Oriol Vinyals, Alex Graves, Koray Kavukcuoglu

NeurIPS 2016 An Online Sequence-to-Sequence Model Using Partial Conditioning Navdeep Jaitly, Quoc V Le, Oriol Vinyals, Ilya Sutskever, David Sussillo, Samy Bengio

NeurIPS 2016 Conditional Image Generation with PixelCNN Decoders Aaron van den Oord, Nal Kalchbrenner, Lasse Espeholt, Koray Kavukcuoglu, Oriol Vinyals, Alex Graves

NeurIPS 2016 Matching Networks for One Shot Learning Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, Daan Wierstra

ICLR 2016 Multi-Task Sequence to Sequence Learning Minh-Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, Lukasz Kaiser

ICLR 2016 Order Matters: Sequence to Sequence for Sets Oriol Vinyals, Samy Bengio, Manjunath Kudlur

NeurIPS 2016 Strategic Attentive Writer for Learning Macro-Actions Alexander Vezhnevets, Volodymyr Mnih, Simon Osindero, Alex Graves, Oriol Vinyals, John Agapiou, Koray Kavukcuoglu

CVPR 2015 Beyond Short Snippets: Deep Networks for Video Classification Joe Yue-Hei Ng, Matthew Hausknecht, Sudheendra Vijayanarasimhan, Oriol Vinyals, Rajat Monga, George Toderici

NeurIPS 2015 Grammar as a Foreign Language Oriol Vinyals, Łukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton

NeurIPS 2015 Pointer Networks Oriol Vinyals, Meire Fortunato, Navdeep Jaitly

ICLR 2015 Qualitatively Characterizing Neural Network Optimization Problems Ian J. Goodfellow, Oriol Vinyals

NeurIPS 2015 Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks Samy Bengio, Oriol Vinyals, Navdeep Jaitly, Noam Shazeer

CVPR 2015 Show and Tell: A Neural Image Caption Generator Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan

ICML 2014 DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, Trevor Darrell

NeurIPS 2014 Sequence to Sequence Learning with Neural Networks Ilya Sutskever, Oriol Vinyals, Quoc V Le

ICML 2013 On Compact Codes for Spatially Pooled Features Yangqing Jia, Oriol Vinyals, Trevor Darrell

ICLR 2013 Why Size Matters: Feature Coding as Nystrom Sampling Oriol Vinyals, Yangqing Jia, Trevor Darrell

AISTATS 2012 Krylov Subspace Descent for Deep Learning Oriol Vinyals, Daniel Povey

NeurIPS 2012 Learning with Recursive Perceptual Representations Oriol Vinyals, Yangqing Jia, Li Deng, Trevor Darrell

CVPR 2007 Learning Kernel Expansions for Image Classification Fernando De la Torre, Oriol Vinyals