Magen, Roey

4 publications

NeurIPS 2025 Benign Overfitting in Single-Head Attention Roey Magen, Shuning Shang, Zhiwei Xu, Spencer Frei, Wei Hu, Gal Vardi
NeurIPS 2025 Transformers Are Almost Optimal Metalearners for Linear Classification Roey Magen, Gal Vardi
NeurIPSW 2024 Benign Overfitting in Single-Head Attention Roey Magen, Shuning Shang, Zhiwei Xu, Spencer Frei, Wei Hu, Gal Vardi
NeurIPS 2023 Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks Roey Magen, Ohad Shamir