Features for Recognition: Viewpoint Invariance for Non-Planar Scenes

Abstract

Most current local feature detectors/descriptors implicitly assume that the scene is (locally) planar, an assumption that is violated at surface discontinuities. We show that this restriction is, at least in theory, unnecessary, as one can construct local features that are viewpoint-invariant for generic non-planar scenes. However, we show that any such feature necessarily sacrifices shape information, in the sense of being non shape-discriminative. Finally, we show that if viewpoint is factored out as part of the matching process, rather than explicitly in the representation, then shape is discriminative indeed. We illustrate our theoretical results empirically by showing that, even for simple scenes, current affine descriptors fail where even a naive 3-D viewpoint invariant succeeds in matching

Cite

Text

Vedaldi and Soatto. "Features for Recognition: Viewpoint Invariance for Non-Planar Scenes." IEEE/CVF International Conference on Computer Vision, 2005. doi:10.1109/ICCV.2005.99

Markdown

[Vedaldi and Soatto. "Features for Recognition: Viewpoint Invariance for Non-Planar Scenes." IEEE/CVF International Conference on Computer Vision, 2005.](https://mlanthology.org/iccv/2005/vedaldi2005iccv-features/) doi:10.1109/ICCV.2005.99

BibTeX

@inproceedings{vedaldi2005iccv-features,
  title     = {{Features for Recognition: Viewpoint Invariance for Non-Planar Scenes}},
  author    = {Vedaldi, Andrea and Soatto, Stefano},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year      = {2005},
  pages     = {1474-1481},
  doi       = {10.1109/ICCV.2005.99},
  url       = {https://mlanthology.org/iccv/2005/vedaldi2005iccv-features/}
}