Chen, Lizhang

8 publications

ICLR 2026 Cautious Optimizers: Improving Training with One Line of Code Kaizhao Liang, Lizhang Chen, Bo Liu, Qiang Liu

ICLR 2026 Cautious Weight Decay Lizhang Chen, Jonathan Li, Kaizhao Liang, Baiyu Su, Cong Xie, Chen Liang, Ni Lao, Qiang Liu

ICLR 2026 DeMo: Decoupled Momentum Optimization Bowen Peng, Lizhang Chen, Baiyu Su, Jeffrey Quesnelle, Diederik P Kingma, Qiang Liu

TMLR 2026 Muon Optimizes Under Spectral Norm Constraints Lizhang Chen, Jonathan Li, Qiang Liu

AISTATS 2025 Memory-Efficient Optimization with Factorized Hamiltonian Descent Son Nguyen, Lizhang Chen, Bo Liu, Qiang Liu

NeurIPS 2024 Communication Efficient Distributed Training with Distributed Lion Bo Liu, Lemeng Wu, Lizhang Chen, Kaizhao Liang, Jiaxu Zhu, Chen Liang, Raghuraman Krishnamoorthi, Qiang Liu

ICLR 2024 Lion Secretly Solves a Constrained Optimization: As Lyapunov Predicts Lizhang Chen, Bo Liu, Kaizhao Liang, Qiang Liu

NeurIPS 2024 Memory-Efficient LLM Training with Online Subspace Descent Kaizhao Liang, Bo Liu, Lizhang Chen, Qiang Liu