A Variational Approach to Bayesian Logistic Regression Models and Their Extensions
Abstract
We consider a logistic regression model with a Gaussian prior distribution over the parameters. We show that accurate variational techniques can be used to obtain a closed form posterior distribution over the parameters given the data thereby yielding a posterior predictive model. The results are readily extended to (binary) belief networks. For belief networks we also derive closed form posteriors in the presence of missing values. Finally, we show that the dual of the regression problem gives a latent variable density model, the variational formulation of which leads to exactly solvable EM updates.
Cite
Text
Jaakkola and Jordan. "A Variational Approach to Bayesian Logistic Regression Models and Their Extensions." Proceedings of the Sixth International Workshop on Artificial Intelligence and Statistics, 1997.Markdown
[Jaakkola and Jordan. "A Variational Approach to Bayesian Logistic Regression Models and Their Extensions." Proceedings of the Sixth International Workshop on Artificial Intelligence and Statistics, 1997.](https://mlanthology.org/aistats/1997/jaakkola1997aistats-variational/)BibTeX
@inproceedings{jaakkola1997aistats-variational,
title = {{A Variational Approach to Bayesian Logistic Regression Models and Their Extensions}},
author = {Jaakkola, Tommi S. and Jordan, Michael I.},
booktitle = {Proceedings of the Sixth International Workshop on Artificial Intelligence and Statistics},
year = {1997},
pages = {283-294},
volume = {R1},
url = {https://mlanthology.org/aistats/1997/jaakkola1997aistats-variational/}
}