ML Anthology

The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation

Douglas DeCarlo, Dimitris N. Metaxas
CVPR 1996 pp. 231-238
doi:10.1109/CVPR.1996.517079 /cvpr/1996/decarlo1996cvpr-integration/

Abstract

We present a formal methodology for the integration of optical flow and deformable models. The optical flow constraint equation provides a non-holonomic constraint on the motion of the deformable model. In this augmented system, forces computed from edges and optical flow are used simultaneously. When this dynamic system is solved, a model-based least-squares solution for the optical flow is obtained and improved estimation results are achieved. The use of a 3-D model reduces or eliminates problems associated with optical flow computation. This approach instantiates a general methodology for treating visual cues as constraints on deformable models. We apply this framework to human face shape and motion estimation. Our 3-D deformable face model uses a small number of parameters to describe a rich variety of face shapes and facial expressions. We present experiments in extracting the shape and motion of a face from image sequences.

CVPR Semantic Scholar

Cite

Text

DeCarlo and Metaxas. "The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1996. doi:10.1109/CVPR.1996.517079

Markdown

[DeCarlo and Metaxas. "The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1996.](https://mlanthology.org/cvpr/1996/decarlo1996cvpr-integration/) doi:10.1109/CVPR.1996.517079

BibTeX

@inproceedings{decarlo1996cvpr-integration,
  title     = {{The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation}},
  author    = {DeCarlo, Douglas and Metaxas, Dimitris N.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {1996},
  pages     = {231-238},
  doi       = {10.1109/CVPR.1996.517079},
  url       = {https://mlanthology.org/cvpr/1996/decarlo1996cvpr-integration/}
}