Wen, Haodong

6 publications

ICLR 2026 How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining Kairong Luo, Zhenbo Sun, Haodong Wen, Xinyu Shi, Jiarui Cui, Chenyi Dang, Kaifeng Lyu, Wenguang Chen

ICLR 2026 Larger Datasets Can Be Repeated More: A Theoretical Analysis of Multi-Epoch Scaling in Linear Regression Tingkai Yan, Haodong Wen, Binghui Li, Kairong Luo, Wenguang Chen, Kaifeng Lyu

ICLR 2025 A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules Kairong Luo, Haodong Wen, Shengding Hu, Zhenbo Sun, Zhiyuan Liu, Maosong Sun, Kaifeng Lyu, Wenguang Chen

NeurIPS 2025 Adam Reduces a Unique Form of Sharpness: Theoretical Insights near the Minimizer Manifold Xinghan Li, Haodong Wen, Kaifeng Lyu

NeurIPSW 2024 A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules Kairong Luo, Haodong Wen, Shengding Hu, Zhenbo Sun, Zhiyuan Liu, Maosong Sun, Kaifeng Lyu, Wenguang Chen

ICLRW 2024 Exploring the Robustness of In-Context Learning with Noisy Labels Chen Cheng, Xinzhi Yu, Haodong Wen, Jingsong Sun, Guanzhang Yue, Yihao Zhang, Zeming Wei