Mixtures of Hierarchical Topics with Pachinko Allocation
Abstract
The four-level pachinko al location model (PAM) (Li & McCallum, 2006) represents correlations among topics using a DAG structure. It does not, however, represent a nested hierarchy of topics, with some topical word distributions representing the vocabulary that is shared among several more specific topics. This paper presents hierarchical PAM -- an enhancement that explicitly represents a topic hierarchy. This model can be seen as combining the advantages of hLD's topical hierarchy representation with PAM's ability to mix multiple leaves of the topic hierarchy. Experimental results show improvements in likelihood of held-out documents, as well as mutual information between automatically-discovered topics and humangenerated categories such as journals.
Cite
Text
Mimno et al. "Mixtures of Hierarchical Topics with Pachinko Allocation." International Conference on Machine Learning, 2007. doi:10.1145/1273496.1273576Markdown
[Mimno et al. "Mixtures of Hierarchical Topics with Pachinko Allocation." International Conference on Machine Learning, 2007.](https://mlanthology.org/icml/2007/mimno2007icml-mixtures/) doi:10.1145/1273496.1273576BibTeX
@inproceedings{mimno2007icml-mixtures,
title = {{Mixtures of Hierarchical Topics with Pachinko Allocation}},
author = {Mimno, David M. and Li, Wei and McCallum, Andrew},
booktitle = {International Conference on Machine Learning},
year = {2007},
pages = {633-640},
doi = {10.1145/1273496.1273576},
url = {https://mlanthology.org/icml/2007/mimno2007icml-mixtures/}
}