Launay, Julien

7 publications

NeurIPS 2023 The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Hamza Alobeidli, Alessandro Cappelli, Baptiste Pannier, Ebtesam Almazrouei, Julien Launay

NeurIPSW 2022 Scaling Laws Beyond Backpropagation Matthew Filipovich, Alessandro Cappelli, Daniel Hesslow, Julien Launay

ICML 2022 What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel

NeurIPSW 2021 Is the Number of Trainable Parameters All That Actually Matters? Amélie Chatelain, Amine Djeghri, Daniel Hesslow, Julien Launay, Iacopo Poli

NeurIPS 2021 Photonic Differential Privacy with Direct Feedback Alignment Ruben Ohana, Hamlet Medina, Julien Launay, Alessandro Cappelli, Iacopo Poli, Liva Ralaivola, Alain Rakotomamonjy

ICMLW 2021 ROPUST: Improving Robustness Through Fine-Tuning with Photonic Processors and Synthetic Gradients Alessandro Cappelli, Ruben Ohana, Julien Launay, Laurent Meunier, Iacopo Poli

NeurIPS 2020 Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay, Iacopo Poli, François Boniface, Florent Krzakala