Yes, but Did It Work?: Evaluating Variational Inference

Abstract

While it’s always possible to compute a variational approximation to a posterior distribution, it can be difficult to discover problems with this approximation. We propose two diagnostic algorithms to alleviate this problem. The Pareto-smoothed importance sampling (PSIS) diagnostic gives a goodness of fit measurement for joint distributions, while simultaneously improving the error in the estimate. The variational simulation-based calibration (VSBC) assesses the average performance of point estimates.

Cite

Text

Yao et al. "Yes, but Did It Work?: Evaluating Variational Inference." International Conference on Machine Learning, 2018.

Markdown

[Yao et al. "Yes, but Did It Work?: Evaluating Variational Inference." International Conference on Machine Learning, 2018.](https://mlanthology.org/icml/2018/yao2018icml-yes/)

BibTeX

@inproceedings{yao2018icml-yes,
  title     = {{Yes, but Did It Work?: Evaluating Variational Inference}},
  author    = {Yao, Yuling and Vehtari, Aki and Simpson, Daniel and Gelman, Andrew},
  booktitle = {International Conference on Machine Learning},
  year      = {2018},
  pages     = {5581-5590},
  volume    = {80},
  url       = {https://mlanthology.org/icml/2018/yao2018icml-yes/}
}