Sun, Zhenbo

3 publications

ICLR 2026 How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining Kairong Luo, Zhenbo Sun, Haodong Wen, Xinyu Shi, Jiarui Cui, Chenyi Dang, Kaifeng Lyu, Wenguang Chen

ICLR 2025 A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules Kairong Luo, Haodong Wen, Shengding Hu, Zhenbo Sun, Zhiyuan Liu, Maosong Sun, Kaifeng Lyu, Wenguang Chen

NeurIPSW 2024 A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules Kairong Luo, Haodong Wen, Shengding Hu, Zhenbo Sun, Zhiyuan Liu, Maosong Sun, Kaifeng Lyu, Wenguang Chen