Ranzato, Marc’Aurelio

12 publications

ICMLW 2024 Asynchronous Local-SGD Training for Language Modeling Bo Liu, Rachita Chhaparia, Arthur Douillard, Satyen Kale, Andrei Alex Rusu, Jiajun Shen, Arthur Szlam, MarcAurelio Ranzato

ICMLW 2024 DiLoCo: Distributed Low-Communication Training of Language Models Arthur Douillard, Qixuan Feng, Andrei Alex Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, MarcAurelio Ranzato, Arthur Szlam, Jiajun Shen

JMLR 2023 Nevis'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research Jorg Bornschein, Alexandre Galashov, Ross Hemsley, Amal Rannen-Triki, Yutian Chen, Arslan Chaudhry, Xu Owen He, Arthur Douillard, Massimo Caccia, Qixuan Feng, Jiajun Shen, Sylvestre-Alvise Rebuffi, Kitty Stacpoole, Diego de las Casas, Will Hawkins, Angeliki Lazaridou, Yee Whye Teh, Andrei A. Rusu, Razvan Pascanu, Marc’Aurelio Ranzato

NeurIPSW 2022 Multi-Step Planning for Automated Hyperparameter Optimization with OptFormer Lucio M. Dery, Abram L. Friesen, Nando de Freitas, MarcAurelio Ranzato, Yutian Chen

CoLLAs 2022 On Anytime Learning at Macroscale Lucas Caccia, Jing Xu, Myle Ott, Marcaurelio Ranzato, Ludovic Denoyer

ICML 2022 Unified Scaling Laws for Routed Language Models Aidan Clark, Diego De Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake Hechtman, Trevor Cai, Sebastian Borgeaud, George Bm Van Den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc’Aurelio Ranzato, Jack Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan

ICLR 2021 Efficient Continual Learning with Modular Networks and Task-Driven Priors Tom Veniat, Ludovic Denoyer, MarcAurelio Ranzato

ICLR 2019 Efficient Lifelong Learning with A-GEM Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, Mohamed Elhoseiny

ICML 2019 Mixture Models for Diverse Machine Translation: Tricks of the Trade Tianxiao Shen, Myle Ott, Michael Auli, Marc’Aurelio Ranzato

ICML 2018 Analyzing Uncertainty in Neural Machine Translation Myle Ott, Michael Auli, David Grangier, Marc’Aurelio Ranzato

AISTATS 2010 Factored 3-Way Restricted Boltzmann Machines for Modeling Natural Images Marc’Aurelio Ranzato, Alex Krizhevsky, Geoffrey Hinton

AISTATS 2007 A Unified Energy-Based Framework for Unsupervised Learning Marc’Aurelio Ranzato, Y-Lan Boureau, Sumit Chopra, Yann LeCun