Resolving Occlusion in Multiframe Reconstruction of Deformable Surfaces

Abstract

Occlusion is troublesome for almost all computer vision algorithms. To a certain extent, the difficulty is alleviated when multiple frames are given. On the other hand, when we consider the recovery of shapes of moving deformable objects, observed using a monocular camera, the problem appears difficult again. In this paper, we show a method that outperforms previous approaches to reconstruction when feature data is unavailable, perhaps due to occlusion. Our key intuition is that portions of the surface that are visible in some frame can be reliably reconstructed in that frame; further, the reliable portions can be stitched together to find even missing portions, much the way a human eye would hallucinate. Our techniques are based on optimization in Riemannian shape spaces, and is demonstrated on isometric surfaces without involving any kind of machine learning methods.

Cite

Text

Shaji et al. "Resolving Occlusion in Multiframe Reconstruction of Deformable Surfaces." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2011. doi:10.1109/CVPRW.2011.5981724

Markdown

[Shaji et al. "Resolving Occlusion in Multiframe Reconstruction of Deformable Surfaces." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2011.](https://mlanthology.org/cvprw/2011/shaji2011cvprw-resolving/) doi:10.1109/CVPRW.2011.5981724

BibTeX

@inproceedings{shaji2011cvprw-resolving,
  title     = {{Resolving Occlusion in Multiframe Reconstruction of Deformable Surfaces}},
  author    = {Shaji, Appu and Varol, Aydin and Fua, Pascal and Yashoteja,  and Jain, A. and Chandran, Sharat},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2011},
  pages     = {31-36},
  doi       = {10.1109/CVPRW.2011.5981724},
  url       = {https://mlanthology.org/cvprw/2011/shaji2011cvprw-resolving/}
}