Ramapuram, Jason

13 publications

ICML 2025 Distillation Scaling Laws Dan Busbridge, Amitis Shidani, Floris Weers, Jason Ramapuram, Etai Littwin, Russell Webb

ICLR 2025 Theory, Analysis, and Best Practices for Sigmoid Self-Attention Jason Ramapuram, Federico Danieli, Eeshan Gunesh Dhekane, Floris Weers, Dan Busbridge, Pierre Ablin, Tatiana Likhomanenko, Jagrit Digani, Zijin Gu, Amitis Shidani, Russell Webb

ICLR 2024 Poly-View Contrastive Learning Amitis Shidani, R Devon Hjelm, Jason Ramapuram, Russell Webb, Eeshan Gunesh Dhekane, Dan Busbridge

ICML 2023 DUET: 2D Structured and Approximately Equivariant Representations Xavier Suau, Federico Danieli, T. Anderson Keller, Arno Blaas, Chen Huang, Jason Ramapuram, Dan Busbridge, Luca Zappella

NeurIPS 2023 How to Scale Your EMA Dan Busbridge, Jason Ramapuram, Pierre Ablin, Tatiana Likhomanenko, Eeshan Gunesh Dhekane, Xavier Suau Cuadros, Russell Webb

ICML 2023 Stabilizing Transformer Training by Preventing Attention Entropy Collapse Shuangfei Zhai, Tatiana Likhomanenko, Etai Littwin, Dan Busbridge, Jason Ramapuram, Yizhe Zhang, Jiatao Gu, Joshua M. Susskind

ICML 2023 The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning Borja Rodrı́guez Gálvez, Arno Blaas, Pau Rodriguez, Adam Golinski, Xavier Suau, Jason Ramapuram, Dan Busbridge, Luca Zappella

ICML 2022 Position Prediction as an Effective Pretraining Strategy Shuangfei Zhai, Navdeep Jaitly, Jason Ramapuram, Dan Busbridge, Tatiana Likhomanenko, Joseph Y Cheng, Walter Talbott, Chen Huang, Hanlin Goh, Joshua M Susskind

NeurIPSW 2021 Challenges of Adversarial Image Augmentations Arno Blaas, Xavier Suau, Jason Ramapuram, Nicholas Apostoloff, Luca Zappella

ICCV 2021 Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts, Jason Ramapuram, Anurag Ranjan, Atulit Kumar, Miguel Angel Bautista, Nathan Paczan, Russ Webb, Joshua M. Susskind

ICLR 2021 Kanerva++: Extending the Kanerva Machine with Differentiable, Locally Block Allocated Latent Memory Jason Ramapuram, Yan Wu, Alexandros Kalousis

NeurIPS 2020 Self-Supervised MultiModal Versatile Networks Jean-Baptiste Alayrac, Adria Recasens, Rosalia Schneider, Relja Arandjelović, Jason Ramapuram, Jeffrey De Fauw, Lucas Smaira, Sander Dieleman, Andrew Zisserman

ECML-PKDD 2018 Large-Scale Nonlinear Variable Selection via Kernel Random Features Magda Gregorová, Jason Ramapuram, Alexandros Kalousis, Stéphane Marchand-Maillet