A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image

Abstract

This paper proposes a novel method for robust 3D object tracking from a monocular RGB image when an object model is available. The proposed method is based on direct image alignment between consecutive frames over a 3D target object. Unlike conventional direct methods that only rely on image intensity, we newly model intensity variations using the surface normal of the object under the Lambertian assumption. From the prediction about image intensity in this model, we also employ a constrained objective function, which significantly alleviates degradation of the tracking performance. In experiments, we evaluate our method using datasets that consist of test sequences under challenging conditions, and demonstrate its benefits compared to other methods.

Cite

Text

Seo and Wuest. "A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image." European Conference on Computer Vision, 2016. doi:10.1007/978-3-319-49409-8_48

Markdown

[Seo and Wuest. "A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image." European Conference on Computer Vision, 2016.](https://mlanthology.org/eccv/2016/seo2016eccv-direct/) doi:10.1007/978-3-319-49409-8_48

BibTeX

@inproceedings{seo2016eccv-direct,
  title     = {{A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image}},
  author    = {Seo, Byung-Kuk and Wuest, Harald},
  booktitle = {European Conference on Computer Vision},
  year      = {2016},
  pages     = {551-562},
  doi       = {10.1007/978-3-319-49409-8_48},
  url       = {https://mlanthology.org/eccv/2016/seo2016eccv-direct/}
}