CLOAF: CoLlisiOn-Aware Human Flow

Abstract

Even the best current algorithms for estimating body 3D shape and pose yield results that include body self-intersections. In this paper we present CLOAF which exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate such self-intersections while still imposing body shape constraints. We show that unlike earlier approaches to addressing this issue ours completely eliminates the self-intersections without compromising the accuracy of the reconstructions. Being differentiable CLOAF can be used to fine-tune pose and shape estimation baselines to improve their overall performance and eliminate self-intersections in their predictions. Furthermore we demonstrate how our CLOAF strategy can be applied to practically any motion field induced by the user. CLOAF also makes it possible to edit motion to interact with the environment without worrying about potential collision or loss of body-shape prior.

Cite

Text

Davydov et al. "CLOAF: CoLlisiOn-Aware Human Flow." Conference on Computer Vision and Pattern Recognition, 2024. doi:10.1109/CVPR52733.2024.00118

Markdown

[Davydov et al. "CLOAF: CoLlisiOn-Aware Human Flow." Conference on Computer Vision and Pattern Recognition, 2024.](https://mlanthology.org/cvpr/2024/davydov2024cvpr-cloaf/) doi:10.1109/CVPR52733.2024.00118

BibTeX

@inproceedings{davydov2024cvpr-cloaf,
  title     = {{CLOAF: CoLlisiOn-Aware Human Flow}},
  author    = {Davydov, Andrey and Engilberge, Martin and Salzmann, Mathieu and Fua, Pascal},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2024},
  pages     = {1176-1185},
  doi       = {10.1109/CVPR52733.2024.00118},
  url       = {https://mlanthology.org/cvpr/2024/davydov2024cvpr-cloaf/}
}