Zhuang, Zhenxun

5 publications

NeurIPS 2022 A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks Mingrui Liu, Zhenxun Zhuang, Yunwen Lei, Chunyang Liao
NeurIPS 2022 Robustness to Unbounded Smoothness of Generalized SignSGD Michael Crawshaw, Mingrui Liu, Francesco Orabona, Wei Zhang, Zhenxun Zhuang
TMLR 2022 Understanding AdamW Through Proximal Methods and Scale-Freeness Zhenxun Zhuang, Mingrui Liu, Ashok Cutkosky, Francesco Orabona
ICML 2021 A Second Look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance Xiaoyu Li, Zhenxun Zhuang, Francesco Orabona
ICML 2019 Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization Zhenxun Zhuang, Ashok Cutkosky, Francesco Orabona