A Real Time Face Tracking and Animation System
Abstract
In this paper, a novel system for real time face tracking and animation is presented. The system is composed of two major components: (1) real time infra-red (IR) based active facial feature tracking, and (2) real time facial expression generation based on a 3D face avatar. Twenty-two feature points, head pose orientation and eye close-open status are effectively extracted through a video input. Based on the detected facial features, a 3D face model is animated by a dynamic inference algorithm and a transformation from facial motion parameters to facial animation parameters. The work can be extended to the fields of real time facial expression analysis and synthesis for applications of human-computer interaction, model-based video conferencing and low bit rate avatar communication. The performance of the developed system is evaluated by its real time implementation for facial expression generation.
Cite
Text
Wei et al. "A Real Time Face Tracking and Animation System." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2004. doi:10.1109/CVPR.2004.288Markdown
[Wei et al. "A Real Time Face Tracking and Animation System." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2004.](https://mlanthology.org/cvpr/2004/wei2004cvpr-real/) doi:10.1109/CVPR.2004.288BibTeX
@inproceedings{wei2004cvpr-real,
title = {{A Real Time Face Tracking and Animation System}},
author = {Wei, Xiaozhou and Zhu, Zhiwei and Yin, Lijun and Ji, Qiang},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2004},
pages = {71},
doi = {10.1109/CVPR.2004.288},
url = {https://mlanthology.org/cvpr/2004/wei2004cvpr-real/}
}