Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization

Abstract

Recent advances in camera relocalization use predictions from a regression forest to guide the camera pose optimization procedure. In these methods, each tree associates one pixel with a point in the scene's 3D world coordinate frame. In previous work, these predictions were point estimates and the subsequent camera pose optimization implicitly assumed an isotropic distribution of these estimates. In this paper, we train a regression forest to predict mixtures of anisotropic 3D Gaussians and show how the predicted uncertainties can be taken into account for continuous pose optimization. Experiments show that our proposed method is able to relocalize up to 40% more frames than the state-of-the-art.

Cite

Text

Valentin et al. "Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization." Conference on Computer Vision and Pattern Recognition, 2015. doi:10.1109/CVPR.2015.7299069

Markdown

[Valentin et al. "Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization." Conference on Computer Vision and Pattern Recognition, 2015.](https://mlanthology.org/cvpr/2015/valentin2015cvpr-exploiting/) doi:10.1109/CVPR.2015.7299069

BibTeX

@inproceedings{valentin2015cvpr-exploiting,
  title     = {{Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization}},
  author    = {Valentin, Julien and Niessner, Matthias and Shotton, Jamie and Fitzgibbon, Andrew and Izadi, Shahram and Torr, Philip H. S.},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2015},
  doi       = {10.1109/CVPR.2015.7299069},
  url       = {https://mlanthology.org/cvpr/2015/valentin2015cvpr-exploiting/}
}