Song, Bingqing

4 publications

NeurIPS 2024 Unraveling the Gradient Descent Dynamics of Transformers Bingqing Song, Boran Han, Shuai Zhang, Jie Ding, Mingyi Hong

ICML 2023 FedAvg Converges to Zero Training Loss Linearly for Overparameterized Multi-Layer Neural Networks Bingqing Song, Prashant Khanduri, Xinwei Zhang, Jinfeng Yi, Mingyi Hong

NeurIPSW 2022 Building Large Machine Learning Models from Small Distributed Models: A Layer Matching Approach Xinwei Zhang, Bingqing Song, Mehrdad Honarkhah, Jie Ding, Mingyi Hong

NeurIPS 2022 Distributed Optimization for Overparameterized Problems: Achieving Optimal Dimension Independent Communication Complexity Bingqing Song, Ioannis Tsaknakis, Chung-Yiu Yau, Hoi-To Wai, Mingyi Hong