Belilovsky, Eugene

73 publications

ICLR 2026 $\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers Benjamin Thérien, Charles-Étienne Joseph, Boris Knyazev, Edouard Oyallon, Irina Rish, Eugene Belilovsky

ICLR 2026 Celo2: Towards Learned Optimization Free Lunch Abhinav Moudgil, Boris Knyazev, Eugene Belilovsky

TMLR 2026 Dual-Phase Continual Learning: Supervised Adaptation Meets Unsupervised Retention Vaibhav Singh, Rahaf Aljundi, Eugene Belilovsky

TMLR 2026 From Feature Visualization to Visual Circuits: Effect of Model Perturbation Geraldin Nanfack, Michael Eickenberg, Eugene Belilovsky

NeurIPS 2025 ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training Adel Nabli, Louis Fournier, Pierre Erbacher, Louis Serrano, Eugene Belilovsky, Edouard Oyallon

ICLR 2025 Accelerating Training with Neuron Interaction and Nowcasting Networks Boris Knyazev, Abhinav Moudgil, Guillaume Lajoie, Eugene Belilovsky, Simon Lacoste-Julien

ICLR 2025 AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien MARTINS Gomes, Yanlei Zhang, Eugene Belilovsky, Guy Wolf, Mahdi S. Hosseini

ICLRW 2025 Adaptive Local Training in Federated Learning Donald Shenaj, Eugene Belilovsky, Pietro Zanuttigh

CoLLAs 2025 Beyond Cosine Decay: On the Effectiveness of Infinite Learning Rate Schedule for Continual Pre-Training Vaibhav Singh, Paul Janson, Paria Mehrbod, Adam Ibrahim, Irina Rish, Eugene Belilovsky, Benjamin Thérien

TMLR 2025 Celo: Training Versatile Learned Optimizers on a Compute Diet Abhinav Moudgil, Boris Knyazev, Guillaume Lajoie, Eugene Belilovsky

TMLR 2025 Continual Pre-Training of MoEs: How Robust Is Your Router? Benjamin Thérien, Charles-Étienne Joseph, Zain Sarwar, Ashwinee Panda, Anirban Das, Shi-Xiong Zhang, Stephen Rawls, Sambit Sahu, Eugene Belilovsky, Irina Rish

TMLR 2025 Meta-Learning Optimizers for Communication-Efficient Learning Charles-Étienne Joseph, Benjamin Thérien, Abhinav Moudgil, Boris Knyazev, Eugene Belilovsky

ICLR 2025 PETRA: Parallel End-to-End Training with Reversible Architectures Stephane Rivaud, Louis Fournier, Thomas Pumir, Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

CoLLAs 2025 Warming up for Zeroth-Order Federated Pre-Training with Low Resource Clients Gwen Legate, Irina Rish, Eugene Belilovsky

NeurIPSW 2024 $\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers Benjamin Thérien, Charles-Étienne Joseph, Boris Knyazev, Edouard Oyallon, Irina Rish, Eugene Belilovsky

NeurIPSW 2024 ACCO: Accumulate While You Communicate, Hiding Communications in Distributed LLM Training Adel Nabli, Louis Fournier, Pierre Erbacher, Louis Serrano, Eugene Belilovsky, Edouard Oyallon

AAAI 2024 Adversarial Attacks on the Interpretation of Neuron Activation Maximization Géraldin Nanfack, Alexander Fulleringer, Jonathan Marty, Michael Eickenberg, Eugene Belilovsky

CoLLAs 2024 Channel-Selective Normalization for Label-Shift Robust Test-Time Adaptation Pedro Vianna, Muawiz Sajjad Chaudhary, Paria Mehrbod, An Tang, Guy Cloutier, Guy Wolf, Michael Eickenberg, Eugene Belilovsky

NeurIPSW 2024 Controlling Forgetting with Test-Time Data in Continual Learning Vaibhav Singh, Rahaf Aljundi, Eugene Belilovsky

ICML 2024 Harmony in Diversity: Merging Neural Networks with Canonical Correlation Analysis Stefan Horoi, Albert Manuel Orozco Camacho, Eugene Belilovsky, Guy Wolf

ICLRW 2024 Harmony in Diversity: Merging Neural Networks with Canonical Correlation Analysis Stefan Horoi, Albert Manuel Orozco Camacho, Eugene Belilovsky, Guy Wolf

ICMLW 2024 Model Breadcrumbs: Scalable Upcycling of Finetuned Foundation Models via Sparse Task Vectors Merging MohammadReza Davari, Eugene Belilovsky

ECCV 2024 Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks MohammadReza Davari, Eugene Belilovsky

TMLR 2024 Simple and Scalable Strategies to Continually Pre-Train Large Language Models Adam Ibrahim, Benjamin Thérien, Kshitij Gupta, Mats Leon Richter, Quentin Gregory Anthony, Eugene Belilovsky, Timothée Lesort, Irina Rish

ECCVW 2024 Towards Motion from Video Diffusion Models Paul Janson, Tiberiu Popa, Eugene Belilovsky

NeurIPSW 2024 Understanding Permutation Based Model Merging with Feature Visualizations Congshu Zou, Geraldin Nanfack, Stefan Horoi, Eugene Belilovsky

NeurIPSW 2024 WASH: Train Your Ensemble with Communication-Efficient Weight Shuffling, Then Average Louis Fournier, Adel Nabli, Masih Aminbeidokhti, Marco Pedersoli, Eugene Belilovsky, Edouard Oyallon

NeurIPS 2023 $\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning Adel Nabli, Eugene Belilovsky, Edouard Oyallon

ICML 2023 Can Forward Gradient Match Backpropagation? Louis Fournier, Stephane Rivaud, Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

NeurIPSW 2023 Channel Selection for Test-Time Adaptation Under Distribution Shift Pedro Vianna, Muawiz Sajjad Chaudhary, An Tang, Guy Cloutier, Guy Wolf, Michael Eickenberg, Eugene Belilovsky

ICMLW 2023 Continual Pre-Training of Large Language Models: How to Re-Warm Your Model? Kshitij Gupta, Benjamin Thérien, Adam Ibrahim, Mats Leon Richter, Quentin Gregory Anthony, Eugene Belilovsky, Irina Rish, Timothée Lesort

TMLR 2023 Gradient Masked Averaging for Federated Learning Irene Tenison, Sai Aravind Sreeramadas, Vaikkunth Mugunthan, Edouard Oyallon, Irina Rish, Eugene Belilovsky

NeurIPS 2023 Guiding the Last Layer in Federated Learning with Pre-Trained Models Gwen Legate, Nicolas Bernier, Lucas Page-Caccia, Edouard Oyallon, Eugene Belilovsky

ICMLW 2023 Guiding the Last Layer in Federated Learning with Pre-Trained Models Gwen Legate, Nicolas Bernier, Lucas Caccia, Edouard Oyallon, Eugene Belilovsky

NeurIPSW 2023 Learning Optimizers for Local SGD Charles-Étienne Joseph, Benjamin Thérien, Abhinav Moudgil, Boris Knyazev, Eugene Belilovsky

ICMLW 2023 Learning to Optimize with Recurrent Hierarchical Transformers Abhinav Moudgil, Boris Knyazev, Guillaume Lajoie, Eugene Belilovsky

ICMLW 2023 Preventing Dimensional Collapse in Contrastive Local Learning with Subsampling Louis Fournier, Adeetya Patel, Michael Eickenberg, Edouard Oyallon, Eugene Belilovsky

ICML 2023 Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning Nader Asadi, Mohammadreza Davari, Sudhir Mudur, Rahaf Aljundi, Eugene Belilovsky

CoLLAs 2023 Re-Weighted SoftMax Cross-Entropy to Control Forgetting in Federated Learning Gwen Legate, Lucas Caccia, Eugene Belilovsky

ICMLW 2023 Re-Weighted SoftMax Cross-Entropy to Control Forgetting in Federated Learning Gwen Legate, Lucas Caccia, Eugene Belilovsky

ICLR 2023 Reliability of CKA as a Similarity Measure in Deep Learning MohammadReza Davari, Stefan Horoi, Amine Natik, Guillaume Lajoie, Guy Wolf, Eugene Belilovsky

CVPR 2023 Simulated Annealing in Early Layers Leads to Better Generalization Amir M. Sarfi, Zahra Karimpour, Muawiz Chaudhary, Nasir M. Khalid, Mirco Ravanelli, Sudhir Mudur, Eugene Belilovsky

NeurIPSW 2022 Adversarial Attacks on Feature Visualization Methods Jonathan Marty, Eugene Belilovsky, Michael Eickenberg

NeurIPSW 2022 Deceiving the CKA Similarity Measure in Deep Learning MohammadReza Davari, Stefan Horoi, Amine Natik, Guillaume Lajoie, Guy Wolf, Eugene Belilovsky

NeurIPSW 2022 Imitation from Observation with Bootstrapped Contrastive Learning Medric Sonwa, Johanna Hansen, Eugene Belilovsky

NeurIPSW 2022 Imitation from Observation with Bootstrapped Contrastive Learning Medric Sonwa, Johanna Hansen, Eugene Belilovsky

ICLRW 2022 Local Learning with Neuron Groups Adeetya Patel, Michael Eickenberg, Eugene Belilovsky

ICLR 2022 New Insights on Reducing Abrupt Representation Change in Online Continual Learning Lucas Caccia, Rahaf Aljundi, Nader Asadi, Tinne Tuytelaars, Joelle Pineau, Eugene Belilovsky

ICLRW 2022 On the Inadequacy of CKA as a Measure of Similarity in Deep Learning MohammadReza Davari, Stefan Horoi, Amine Natik, Guillaume Lajoie, Guy Wolf, Eugene Belilovsky

CVPR 2022 Parametric Scattering Networks Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf

CVPR 2022 Probing Representation Forgetting in Supervised and Unsupervised Continual Learning MohammadReza Davari, Nader Asadi, Sudhir Mudur, Rahaf Aljundi, Eugene Belilovsky

NeurIPSW 2022 Reducing Forgetting in Federated Learning with Truncated Cross-Entropy Gwen Legate, Lucas Caccia, Eugene Belilovsky

CVPR 2022 Revisiting Learnable Affines for Batch Norm in Few-Shot Transfer Learning Moslem Yazdanpanah, Aamer Abdul Rahman, Muawiz Chaudhary, Christian Desrosiers, Mohammad Havaei, Eugene Belilovsky, Samira Ebrahimi Kahou

ICML 2022 Towards Scaling Difference Target Propagation by Learning Backprop Targets Maxence M Ernoult, Fabrice Normandin, Abhinav Moudgil, Sean Spinney, Eugene Belilovsky, Irina Rish, Blake Richards, Yoshua Bengio

ICCV 2021 Generative Compositional Augmentations for Scene Graph Prediction Boris Knyazev, Harm de Vries, Cătălina Cangea, Graham W. Taylor, Aaron Courville, Eugene Belilovsky

NeurIPSW 2021 Probing Representation Forgetting in Continual Learning MohammadReza Davari, Eugene Belilovsky

NeurIPSW 2021 Shift and Scale Is Detrimental to Few-Shot Transfer Moslem Yazdanpanah, Aamer Abdul Rahman, Christian Desrosiers, Mohammad Havaei, Eugene Belilovsky, Samira Ebrahimi Kahou

NeurIPSW 2021 Tackling Online One-Class Incremental Learning by Removing Negative Contrasts Nader Asadi, Sudhir Mudur, Eugene Belilovsky

ICLR 2021 The Unreasonable Effectiveness of Patches in Deep Convolutional Kernels Methods Louis Thiry, Michael Arbel, Eugene Belilovsky, Edouard Oyallon

ICML 2020 Decoupled Greedy Learning of CNNs Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

ECCV 2020 Few-Shot Single-View 3-D Object Reconstruction with Compositional Priors Mateusz Michalkiewicz, Sarah Parisot, Stavros Tsogkas, Mahsa Baktashmotlagh, Anders Eriksson, Eugene Belilovsky

MLOSS 2020 Kymatio: Scattering Transforms in Python Mathieu Andreux, Tomás Angles, Georgios Exarchakis, Roberto Leonarduzzi, Gaspar Rochette, Louis Thiry, John Zarka, Stéphane Mallat, Joakim Andén, Eugene Belilovsky, Joan Bruna, Vincent Lostanlen, Muawiz Chaudhary, Matthew J. Hirn, Edouard Oyallon, Sixin Zhang, Carmine Cella, Michael Eickenberg

ICML 2020 Online Learned Continual Compression with Adaptive Quantization Modules Lucas Caccia, Eugene Belilovsky, Massimo Caccia, Joelle Pineau

ICML 2019 Greedy Layerwise Learning Can Scale to ImageNet Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon

NeurIPS 2019 Online Continual Learning with Maximal Interfered Retrieval Rahaf Aljundi, Eugene Belilovsky, Tinne Tuytelaars, Laurent Charlin, Massimo Caccia, Min Lin, Lucas Page-Caccia

ECCV 2018 Compressing the Input for CNNs with the First-Order Scattering Transform Edouard Oyallon, Eugene Belilovsky, Sergey Zagoruyko, Michal Valko

ICLR 2017 Joint Embeddings of Scene Graphs and Images Eugene Belilovsky, Matthew B. Blaschko, Jamie Ryan Kiros, Raquel Urtasun, Richard S. Zemel

ICML 2017 Learning to Discover Sparse Graphical Models Eugene Belilovsky, Kyle Kastner, Gael Varoquaux, Matthew B. Blaschko

ICLR 2017 Learning to Discover Sparse Graphical Models Eugene Belilovsky, Kyle Kastner, Gaël Varoquaux, Matthew B. Blaschko

ICCV 2017 Scaling the Scattering Transform: Deep Hybrid Networks Edouard Oyallon, Eugene Belilovsky, Sergey Zagoruyko

ICLR 2016 A Test of Relative Similarity for Model Selection in Generative Models Wacha Bounliphone, Eugene Belilovsky, Matthew B. Blaschko, Ioannis Antonoglou, Arthur Gretton

NeurIPS 2016 Testing for Differences in Gaussian Graphical Models: Applications to Brain Connectivity Eugene Belilovsky, Gaël Varoquaux, Matthew B Blaschko

MLJ 2015 Convex Relaxations of Penalties for Sparse Correlated Variables with Bounded Total Variation Eugene Belilovsky, Andreas Argyriou, Gaël Varoquaux, Matthew B. Blaschko