Fournier, Louis

7 publications

NeurIPS 2025 ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training Adel Nabli, Louis Fournier, Pierre Erbacher, Louis Serrano, Eugene Belilovsky, Edouard Oyallon

ICLR 2025 PETRA: Parallel End-to-End Training with Reversible Architectures Stephane Rivaud, Louis Fournier, Thomas Pumir, Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

NeurIPSW 2024 ACCO: Accumulate While You Communicate, Hiding Communications in Distributed LLM Training Adel Nabli, Louis Fournier, Pierre Erbacher, Louis Serrano, Eugene Belilovsky, Edouard Oyallon

NeurIPSW 2024 Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks Louis Fournier, Edouard Oyallon

NeurIPSW 2024 WASH: Train Your Ensemble with Communication-Efficient Weight Shuffling, Then Average Louis Fournier, Adel Nabli, Masih Aminbeidokhti, Marco Pedersoli, Eugene Belilovsky, Edouard Oyallon

ICML 2023 Can Forward Gradient Match Backpropagation? Louis Fournier, Stephane Rivaud, Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

ICMLW 2023 Preventing Dimensional Collapse in Contrastive Local Learning with Subsampling Louis Fournier, Adeetya Patel, Michael Eickenberg, Edouard Oyallon, Eugene Belilovsky