Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
Abstract
We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle highly nonlinear input data with temporal and spatial dependencies such as image sequences without domain knowledge. Our experiments show that enabling backpropagation through transitions enforces state space assumptions and significantly improves information content of the latent embedding. This also enables realistic long-term prediction.
Cite
Text
Karl et al. "Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data." International Conference on Learning Representations, 2017.Markdown
[Karl et al. "Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data." International Conference on Learning Representations, 2017.](https://mlanthology.org/iclr/2017/karl2017iclr-deep/)BibTeX
@inproceedings{karl2017iclr-deep,
title = {{Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data}},
author = {Karl, Maximilian and Soelch, Maximilian and Bayer, Justin and van der Smagt, Patrick},
booktitle = {International Conference on Learning Representations},
year = {2017},
url = {https://mlanthology.org/iclr/2017/karl2017iclr-deep/}
}