Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences

Abstract

We show that we can effectively and automatically fit a complex facial animation model to uncalibrated image sequences. Our approach is based on model-driven bundle adjustment followed by least squares fitting. It takes advantage of three complementary sources of information: stereo data, silhouette edges and 2D feature points. In this way, complete head models can be acquired with a cheap and entirely passive sensor such as an ordinary video camera. They can then be fed to existing animation software to produce synthetic sequences.

Cite

Text

Fua. "Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences." IEEE/CVF International Conference on Computer Vision, 1999. doi:10.1109/ICCV.1999.791196

Markdown

[Fua. "Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences." IEEE/CVF International Conference on Computer Vision, 1999.](https://mlanthology.org/iccv/1999/fua1999iccv-using/) doi:10.1109/ICCV.1999.791196

BibTeX

@inproceedings{fua1999iccv-using,
  title     = {{Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences}},
  author    = {Fua, Pascal},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year      = {1999},
  pages     = {46-53},
  doi       = {10.1109/ICCV.1999.791196},
  url       = {https://mlanthology.org/iccv/1999/fua1999iccv-using/}
}