Katharopoulos, Angelos

10 publications

ICLR 2025 No Need to Talk: Asynchronous Mixture of Language Models Anastasiia Filippova, Angelos Katharopoulos, David Grangier, Ronan Collobert
ICML 2025 Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging Pierre Ablin, Angelos Katharopoulos, Skyler Seto, David Grangier
ICLRW 2025 Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging Pierre Ablin, Angelos Katharopoulos, Skyler Seto, David Grangier
ICMLW 2024 Projected Language Models: A Large Model Pre-Segmented into Smaller Ones David Grangier, Angelos Katharopoulos, Pierre Ablin, Awni Hannun
CVPR 2023 Masked Autoencoding Does Not Help Natural Language Supervision at Scale Floris Weers, Vaishaal Shankar, Angelos Katharopoulos, Yinfei Yang, Tom Gunter
CVPR 2021 Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networks Despoina Paschalidou, Angelos Katharopoulos, Andreas Geiger, Sanja Fidler
NeurIPS 2020 Fast Transformers with Clustered Attention Apoorv Vyas, Angelos Katharopoulos, François Fleuret
ICML 2020 Transformers Are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, François Fleuret
ICML 2019 Processing Megapixel Images with Deep Attention-Sampling Models Angelos Katharopoulos, Francois Fleuret
ICML 2018 Not All Samples Are Created Equal: Deep Learning with Importance Sampling Angelos Katharopoulos, Francois Fleuret