Motion Capture of Hands in Action Using Discriminative Salient Points

Abstract

Capturing the motion of two hands interacting with an object is a very challenging task due to the large number of degrees of freedom, self-occlusions, and similarity between the fingers, even in the case of multiple cameras observing the scene. In this paper we propose to use discriminatively learned salient points on the fingers and to estimate the finger-salient point associations simultaneously with the estimation of the hand pose. We introduce a differentiable objective function that also takes edges, optical flow and collisions into account. Our qualitative and quantitative evaluations show that the proposed approach achieves very accurate results for several challenging sequences containing hands and objects in action.

Cite

Text

Ballan et al. "Motion Capture of Hands in Action Using Discriminative Salient Points." European Conference on Computer Vision, 2012. doi:10.1007/978-3-642-33783-3_46

Markdown

[Ballan et al. "Motion Capture of Hands in Action Using Discriminative Salient Points." European Conference on Computer Vision, 2012.](https://mlanthology.org/eccv/2012/ballan2012eccv-motion/) doi:10.1007/978-3-642-33783-3_46

BibTeX

@inproceedings{ballan2012eccv-motion,
  title     = {{Motion Capture of Hands in Action Using Discriminative Salient Points}},
  author    = {Ballan, Luca and Taneja, Aparna and Gall, Jürgen and Van Gool, Luc and Pollefeys, Marc},
  booktitle = {European Conference on Computer Vision},
  year      = {2012},
  pages     = {640-653},
  doi       = {10.1007/978-3-642-33783-3_46},
  url       = {https://mlanthology.org/eccv/2012/ballan2012eccv-motion/}
}