He, Bobby

16 publications

ICLR 2025 The Directionality of Optimization Trajectories in Neural Networks Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf

ICMLW 2024 Feature Learning Dynamics Under Grokking in a Sparse Parity Task Javier Sanguino Bautiste, Gregor Bachmann, Bobby He, Lorenzo Noci, Thomas Hofmann

ICMLW 2024 Hallmarks of Optimization Trajectories in Neural Networks and LLMs: Directional Exploration and Redundancy Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf

ICML 2024 Recurrent Distance Filtering for Graph Representation Learning Yuhui Ding, Antonio Orvieto, Bobby He, Thomas Hofmann

ICLR 2024 Simplifying Transformer Blocks Bobby He, Thomas Hofmann

NeurIPSW 2024 Testing Knowledge Distillation Theories with Dataset Size Giulia Lanzillotta, Felix Sarnthein, Gil Kur, Thomas Hofmann, Bobby He

ICMLW 2024 Understanding and Minimising Outlier Features in Neural Network Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

ICMLW 2024 Understanding and Minimising Outlier Features in Neural Network Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

NeurIPS 2024 Understanding and Minimising Outlier Features in Transformer Training Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

ICLR 2023 Deep Transformers Without Shortcuts: Modifying Self-Attention for Faithful Signal Propagation Bobby He, James Martens, Guodong Zhang, Aleksandar Botev, Andrew Brock, Samuel L Smith, Yee Whye Teh

NeurIPS 2023 The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit Lorenzo Noci, Chuning Li, Mufan Li, Bobby He, Thomas Hofmann, Chris J Maddison, Dan Roy

TMLR 2023 UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography Francisca Vasconcelos, Bobby He, Nalini M Singh, Yee Whye Teh

ICML 2022 Exploring the Gap Between Collapsed & Whitened Features in Self-Supervised Learning Bobby He, Mete Ozay

ICLR 2022 Feature Kernel Distillation Bobby He, Mete Ozay

AISTATS 2021 Stable ResNet Soufiane Hayou, Eugenio Clerico, Bobby He, George Deligiannidis, Arnaud Doucet, Judith Rousseau

NeurIPS 2020 Bayesian Deep Ensembles via the Neural Tangent Kernel Bobby He, Balaji Lakshminarayanan, Yee Whye Teh