DG-LMC: A Turn-Key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo Within Gibbs
Abstract
Performing reliable Bayesian inference on a big data scale is becoming a keystone in the modern era of machine learning. A workhorse class of methods to achieve this task are Markov chain Monte Carlo (MCMC) algorithms and their design to handle distributed datasets has been the subject of many works. However, existing methods are not completely either reliable or computationally efficient. In this paper, we propose to fill this gap in the case where the dataset is partitioned and stored on computing nodes within a cluster under a master/slaves architecture. We derive a user-friendly centralised distributed MCMC algorithm with provable scaling in high-dimensional settings. We illustrate the relevance of the proposed methodology on both synthetic and real data experiments.
Cite
Text
Plassier et al. "DG-LMC: A Turn-Key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo Within Gibbs." International Conference on Machine Learning, 2021.Markdown
[Plassier et al. "DG-LMC: A Turn-Key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo Within Gibbs." International Conference on Machine Learning, 2021.](https://mlanthology.org/icml/2021/plassier2021icml-dglmc/)BibTeX
@inproceedings{plassier2021icml-dglmc,
title = {{DG-LMC: A Turn-Key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo Within Gibbs}},
author = {Plassier, Vincent and Vono, Maxime and Durmus, Alain and Moulines, Eric},
booktitle = {International Conference on Machine Learning},
year = {2021},
pages = {8577-8587},
volume = {139},
url = {https://mlanthology.org/icml/2021/plassier2021icml-dglmc/}
}