Parallel Markov Chain Monte Carlo for Pitman-Yor Mixture Models
Abstract
The Pitman-Yor process provides an elegant way to cluster data that exhibit power law behavior, where the number of clusters is unknown or unbounded. Unfortunately, inference in PitmanYor process-based models is typically slow and does not scale well with dataset size. In this paper we present new auxiliary-variable representations for the Pitman-Yor process and a special case of the hierarchical Pitman-Yor process that allows us to develop parallel inference algorithms that distribute inference both on the data space and the model space. We show that our method scales well with increasing data while avoiding any degradation in estimate quality
Cite
Text
Dubey et al. "Parallel Markov Chain Monte Carlo for Pitman-Yor Mixture Models." Conference on Uncertainty in Artificial Intelligence, 2014.Markdown
[Dubey et al. "Parallel Markov Chain Monte Carlo for Pitman-Yor Mixture Models." Conference on Uncertainty in Artificial Intelligence, 2014.](https://mlanthology.org/uai/2014/dubey2014uai-parallel/)BibTeX
@inproceedings{dubey2014uai-parallel,
title = {{Parallel Markov Chain Monte Carlo for Pitman-Yor Mixture Models}},
author = {Dubey, Kumar Avinava and Williamson, Sinead and Xing, Eric P.},
booktitle = {Conference on Uncertainty in Artificial Intelligence},
year = {2014},
pages = {142-151},
url = {https://mlanthology.org/uai/2014/dubey2014uai-parallel/}
}