Sarrof, Yash

3 publications

ICLR 2025 A Formal Framework for Understanding Length Generalization in Transformers Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, Andreas Krebs, Hattie Zhou, Preetum Nakkiran, Michael Hahn

NeurIPS 2025 Born a Transformer -- Always a Transformer? on the Effect of Pretraining on Architectural Abilities Mayank Jobanputra, Yana Veitsman, Yash Sarrof, Aleksandra Bakalova, Vera Demberg, Ellie Pavlick, Michael Hahn

NeurIPS 2024 The Expressive Capacity of State Space Models: A Formal Language Perspective Yash Sarrof, Yana Veitsman, Michael Hahn