Contact-Aware Retargeting of Skinned Motion

Abstract

This paper introduces a motion retargeting method that preserves self-contacts and prevents inter-penetration. Self-contacts, such as when hands touch each other or the torso or the head, are important attributes of human body language and dynamics, yet existing methods do not model or preserve these contacts. Likewise, self-penetrations, such as a hand passing into the torso, are a typical artifact of motion estimation methods. The input to our method is a human motion sequence and a target skeleton and character geometry. The method identifies self-contacts and ground contacts in the input motion, and optimizes the motion to apply to the output skeleton, while preserving these contacts and reducing self-penetrations. We introduce a novel geometry-conditioned recurrent network with an encoder-space optimization strategy that achieves efficient retargeting while satisfying contact constraints. In experiments, our results quantitatively outperform previous methods and in the user study our retargeted motions are rated as higher-quality than those produced by recent works. We also show our method generalizes to motion estimated from human videos where we improve over previous works that produce noticeable interpenetration.

Cite

Text

Villegas et al. "Contact-Aware Retargeting of Skinned Motion." International Conference on Computer Vision, 2021. doi:10.1109/ICCV48922.2021.00958

Markdown

[Villegas et al. "Contact-Aware Retargeting of Skinned Motion." International Conference on Computer Vision, 2021.](https://mlanthology.org/iccv/2021/villegas2021iccv-contactaware/) doi:10.1109/ICCV48922.2021.00958

BibTeX

@inproceedings{villegas2021iccv-contactaware,
  title     = {{Contact-Aware Retargeting of Skinned Motion}},
  author    = {Villegas, Ruben and Ceylan, Duygu and Hertzmann, Aaron and Yang, Jimei and Saito, Jun},
  booktitle = {International Conference on Computer Vision},
  year      = {2021},
  pages     = {9720-9729},
  doi       = {10.1109/ICCV48922.2021.00958},
  url       = {https://mlanthology.org/iccv/2021/villegas2021iccv-contactaware/}
}