Physics-Based Person Tracking Using Simplified Lower-Body Dynamics

Abstract

We introduce a physics-based model for 3D person tracking. Based on a biomechanical characterization of lower-body dynamics, the model captures important physical properties of bipedal locomotion such as balance and ground contact, generalizes naturally to variations in style due to changes in speed, step-length, and mass, and avoids common problems such as footskate that arise with existing trackers. The model dynamics comprises a two degree-of-freedom representation of human locomotion with inelastic ground contact. A stochastic controller generates impulsive forces during the toe-off stage of walking and spring-like forces between the legs. A higher-dimensional kinematic observation model is then conditioned on the underlying dynamics. We use the model for tracking walking people from video, including examples with turning, occlusion, and varying gait.

Cite

Text

Brubaker et al. "Physics-Based Person Tracking Using Simplified Lower-Body Dynamics." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2007. doi:10.1109/CVPR.2007.383342

Markdown

[Brubaker et al. "Physics-Based Person Tracking Using Simplified Lower-Body Dynamics." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2007.](https://mlanthology.org/cvpr/2007/brubaker2007cvpr-physics/) doi:10.1109/CVPR.2007.383342

BibTeX

@inproceedings{brubaker2007cvpr-physics,
  title     = {{Physics-Based Person Tracking Using Simplified Lower-Body Dynamics}},
  author    = {Brubaker, Marcus A. and Fleet, David J. and Hertzmann, Aaron},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2007},
  doi       = {10.1109/CVPR.2007.383342},
  url       = {https://mlanthology.org/cvpr/2007/brubaker2007cvpr-physics/}
}