An Asynchronous Bundle Method for Distributed Learning Problems

Abstract

We propose a novel asynchronous bundle method to solve distributed learning problems. Compared to existing asynchronous methods, our algorithm computes the next iterate based on a more accurate approximation of the objective function and does not require any prior information about the maximal information delay in the system. This makes the proposed method fast and easy to tune. We prove that the algorithm converges in both deterministic and stochastic (mini-batch) settings, and quantify how the convergence times depend on the level of asynchrony. The practical advantages of our method are illustrated through numerical experiments on classification problems of varying complexities and scales.

Cite

Text

Cederberg et al. "An Asynchronous Bundle Method for Distributed Learning Problems." International Conference on Learning Representations, 2025.

Markdown

[Cederberg et al. "An Asynchronous Bundle Method for Distributed Learning Problems." International Conference on Learning Representations, 2025.](https://mlanthology.org/iclr/2025/cederberg2025iclr-asynchronous/)

BibTeX

@inproceedings{cederberg2025iclr-asynchronous,
  title     = {{An Asynchronous Bundle Method for Distributed Learning Problems}},
  author    = {Cederberg, Daniel and Wu, Xuyang and Boyd, Stephen P. and Johansson, Mikael},
  booktitle = {International Conference on Learning Representations},
  year      = {2025},
  url       = {https://mlanthology.org/iclr/2025/cederberg2025iclr-asynchronous/}
}