ML Anthology
Authors
Search
About
Luo, Kairong
4 publications
ICLR
2026
How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining
Kairong Luo
,
Zhenbo Sun
,
Haodong Wen
,
Xinyu Shi
,
Jiarui Cui
,
Chenyi Dang
,
Kaifeng Lyu
,
Wenguang Chen
ICLR
2026
Larger Datasets Can Be Repeated More: A Theoretical Analysis of Multi-Epoch Scaling in Linear Regression
Tingkai Yan
,
Haodong Wen
,
Binghui Li
,
Kairong Luo
,
Wenguang Chen
,
Kaifeng Lyu
ICLR
2025
A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
Kairong Luo
,
Haodong Wen
,
Shengding Hu
,
Zhenbo Sun
,
Zhiyuan Liu
,
Maosong Sun
,
Kaifeng Lyu
,
Wenguang Chen
NeurIPSW
2024
A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
Kairong Luo
,
Haodong Wen
,
Shengding Hu
,
Zhenbo Sun
,
Zhiyuan Liu
,
Maosong Sun
,
Kaifeng Lyu
,
Wenguang Chen