Behrens, Freya

8 publications

ICML 2025 Counting in Small Transformers: The Delicate Interplay Between Attention and Feed-Forward Layers Freya Behrens, Luca Biggio, Lenka Zdeborova

ICLRW 2025 Knowledge Distillation for Random Data: Soft Labels and Similarity Scores May Contain Memorized Information Freya Behrens

NeurIPS 2024 A Phase Transition Between Positional and Semantic Learning in a Solvable Model of Dot-Product Attention Hugo Cui, Freya Behrens, Florent Krzakala, Lenka Zdeborová

ICMLW 2024 A Phase Transition Between Positional and Semantic Learning in a Solvable Model of Dot-Product Attention Hugo Cui, Freya Behrens, Florent Krzakala, Lenka Zdeborova

ICMLW 2024 Understanding Counting in Small Transformers: The Interplay Between Attention and Feed-Forward Layers Freya Behrens, Luca Biggio, Lenka Zdeborova

NeurIPSW 2023 Unveiling the Hessian's Connection to the Decision Boundary Mahalakshmi Sabanayagam, Freya Behrens, Urte Adomaityte, Anna Dawid

ICLR 2021 Neurally Augmented ALISTA Freya Behrens, Jonathan Sauder, Peter Jung

NeurIPSW 2020 Towards Neurally Augmented ALISTA Freya Behrens, Jonathan Sauder, Peter Jung