Schlag, Imanol

19 publications

ICLR 2025 INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge Angelika Romanou, Negar Foroutan, Anna Sotnikova, Sree Harsha Nelaturu, Shivalika Singh, Rishabh Maheshwary, Micol Altomare, Zeming Chen, Mohamed A. Haggag, Snegha A, Alfonso Amayuelas, Azril Hafizi Amirudin, Danylo Boiko, Michael Chang, Jenny Chim, Gal Cohen, Aditya Kumar Dalmia, Abraham Diress, Sharad Duwal, Daniil Dzenhaliou, Daniel Fernando Erazo Florez, Fabian Farestam, Joseph Marvin Imperial, Shayekh Bin Islam, Perttu Isotalo, Maral Jabbarishiviari, Börje F. Karlsson, Eldar Khalilov, Christopher Klamm, Fajri Koto, Dominik Krzemiński, Gabriel Adriano de Melo, Syrielle Montariol, Yiyang Nan, Joel Niklaus, Jekaterina Novikova, Johan Samir Obando Ceron, Debjit Paul, Esther Ploeger, Jebish Purbey, Swati Rajwal, Selvan Sunitha Ravi, Sara Rydell, Roshan Santhosh, Drishti Sharma, Marjana Prifti Skenduli, Arshia Soltani Moakhar, Bardia soltani Moakhar, Ayush Kumar Tarun, Azmine Toushik Wasi, Thenuka Ovin Weerasinghe, Serhan Yilmaz, Mike Zhang, Imanol Schlag, Marzieh Fadaee, Sara Hooker, Antoine Bosselut

NeurIPS 2025 Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks Yixuan Xu, Antoine Bosselut, Imanol Schlag

NeurIPS 2025 Towards Fully FP8 GEMM LLM Training at Scale Alejandro Hernández-Cano, Dhia Garbaya, Imanol Schlag, Martin Jaggi

ICML 2024 Navigating Scaling Laws: Compute Optimality in Adaptive Model Training Sotiris Anagnostidis, Gregor Bachmann, Imanol Schlag, Thomas Hofmann

ICMLW 2024 Understanding and Minimising Outlier Features in Neural Network Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

ICMLW 2024 Understanding and Minimising Outlier Features in Neural Network Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

NeurIPS 2024 Understanding and Minimising Outlier Features in Transformer Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

NeurIPSW 2023 Mindstorms in Natural Language-Based Societies of Mind Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piękos, Aditya Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanić, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jürgen Schmidhuber

ICML 2022 A Modern Self-Referential Weight Matrix That Learns to Modify Itself Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

NeurIPS 2022 Block-Recurrent Transformers DeLesley Hutchins, Imanol Schlag, Yuhuai Wu, Ethan Dyer, Behnam Neyshabur

NeurIPS 2022 Solving Quantitative Reasoning Problems with Language Models Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

NeurIPSW 2021 A Modern Self-Referential Weight Matrix That Learns to Modify Itself Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

NeurIPSW 2021 Augmenting Classic Algorithms with Neural Components for Strong Generalisation on Ambiguous and High-Dimensional Data Imanol Schlag, Jürgen Schmidhuber

NeurIPS 2021 Going Beyond Linear Transformers with Recurrent Fast Weight Programmers Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

NeurIPSW 2021 Improving Baselines in the Wild Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

ICLR 2021 Learning Associative Inference Using Fast Weight Memory Imanol Schlag, Tsendsuren Munkhdalai, Jürgen Schmidhuber

ICML 2021 Linear Transformers Are Secretly Fast Weight Programmers Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

NeurIPS 2018 Learning to Reason with Third Order Tensor Products Imanol Schlag, Jürgen Schmidhuber

ICCVW 2017 Ancient Roman Coin Recognition in the Wild Using Deep Learning Based Recognition of Artistically Depicted Face Profiles Imanol Schlag, Ognjen Arandjelovic