Batch and On-Line Parameter Estimation of Gaussian Mixtures Based on the Joint Entropy
Abstract
We describe a new iterative method for parameter estimation of Gaus(cid:173) sian mixtures. The new method is based on a framework developed by Kivinen and Warmuth for supervised on-line learning. In contrast to gra(cid:173) dient descent and EM, which estimate the mixture's covariance matrices, the proposed method estimates the inverses of the covariance matrices. Furthennore, the new parameter estimation procedure can be applied in both on-line and batch settings. We show experimentally that it is typi(cid:173) cally faster than EM, and usually requires about half as many iterations as EM.
Cite
Text
Singer and Warmuth. "Batch and On-Line Parameter Estimation of Gaussian Mixtures Based on the Joint Entropy." Neural Information Processing Systems, 1998.Markdown
[Singer and Warmuth. "Batch and On-Line Parameter Estimation of Gaussian Mixtures Based on the Joint Entropy." Neural Information Processing Systems, 1998.](https://mlanthology.org/neurips/1998/singer1998neurips-batch/)BibTeX
@inproceedings{singer1998neurips-batch,
title = {{Batch and On-Line Parameter Estimation of Gaussian Mixtures Based on the Joint Entropy}},
author = {Singer, Yoram and Warmuth, Manfred K.},
booktitle = {Neural Information Processing Systems},
year = {1998},
pages = {578-584},
url = {https://mlanthology.org/neurips/1998/singer1998neurips-batch/}
}