Caccia, Lucas

17 publications

TMLR 2025 A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning Prateek Yadav, Colin Raffel, Mohammed Muqeeth, Lucas Caccia, Haokun Liu, Tianlong Chen, Mohit Bansal, Leshem Choshen, Alessandro Sordoni

ICLRW 2025 Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Doina Precup, Lucas Caccia, Alessandro Sordoni

NeurIPS 2025 Learning to Solve Complex Problems via Dataset Decomposition Wanru Zhao, Lucas Caccia, Zhengyan Shi, Minseon Kim, Weijia Xu, Alessandro Sordoni

ICLRW 2025 Training Plug N' Play Knowledge Modules with Deep Context Distillation Lucas Caccia, Alan Ansell, Ivan Vulić, Edoardo Ponti, Alessandro Sordoni

ICML 2024 Towards Modular LLMs by Building and Reusing a Library of LoRAs Oleksiy Ostapenko, Zhan Su, Edoardo Ponti, Laurent Charlin, Nicolas Le Roux, Lucas Caccia, Alessandro Sordoni

NeurIPSW 2023 A Case Study of Instruction Tuning with Mixture of Parameter-Efficient Experts Oleksiy Ostapenko, Lucas Caccia, Zhan Su, Nicolas Le Roux, Laurent Charlin, Alessandro Sordoni

ICLR 2023 Building a Subspace of Policies for Scalable Continual Learning Jean-Baptiste Gaya, Thang Doan, Lucas Caccia, Laure Soulier, Ludovic Denoyer, Roberta Raileanu

ICMLW 2023 Guiding the Last Layer in Federated Learning with Pre-Trained Models Gwen Legate, Nicolas Bernier, Lucas Caccia, Edouard Oyallon, Eugene Belilovsky

CoLLAs 2023 Re-Weighted SoftMax Cross-Entropy to Control Forgetting in Federated Learning Gwen Legate, Lucas Caccia, Eugene Belilovsky

ICMLW 2023 Re-Weighted SoftMax Cross-Entropy to Control Forgetting in Federated Learning Gwen Legate, Lucas Caccia, Eugene Belilovsky

ICMLW 2022 Building a Subspace of Policies for Scalable Continual Learning Jean-Baptiste Gaya, Thang Doan, Lucas Caccia, Laure Soulier, Ludovic Denoyer, Roberta Raileanu

NeurIPSW 2022 Building a Subspace of Policies for Scalable Continual Learning Jean-Baptiste Gaya, Thang Doan, Lucas Caccia, Laure Soulier, Ludovic Denoyer, Roberta Raileanu

ICLR 2022 New Insights on Reducing Abrupt Representation Change in Online Continual Learning Lucas Caccia, Rahaf Aljundi, Nader Asadi, Tinne Tuytelaars, Joelle Pineau, Eugene Belilovsky

CoLLAs 2022 On Anytime Learning at Macroscale Lucas Caccia, Jing Xu, Myle Ott, Marcaurelio Ranzato, Ludovic Denoyer

NeurIPSW 2022 Reducing Forgetting in Federated Learning with Truncated Cross-Entropy Gwen Legate, Lucas Caccia, Eugene Belilovsky

ICLR 2020 Language GANs Falling Short Massimo Caccia, Lucas Caccia, William Fedus, Hugo Larochelle, Joelle Pineau, Laurent Charlin

ICML 2020 Online Learned Continual Compression with Adaptive Quantization Modules Lucas Caccia, Eugene Belilovsky, Massimo Caccia, Joelle Pineau