Learning Identity-Invariant Motion Representations for Cross-ID Face Reenactment
Abstract
Human face reenactment aims at transferring motion patterns from one face (from a source-domain video) to an-other (in the target domain with the identity of interest).While recent works report impressive results, they are notable to handle multiple identities in a unified model. In this paper, we propose a unique network of CrossID-GAN to perform multi-ID face reenactment. Given a source-domain video with extracted facial landmarks and a target-domain image, our CrossID-GAN learns the identity-invariant motion patterns via the extracted landmarks and such information to produce the videos whose ID matches that of the target domain. Both supervised and unsupervised settings are proposed to train and guide our model during training. Our qualitative/quantitative results confirm the robustness and effectiveness of our model, with ablation studies confirming our network design.
Cite
Text
Huang et al. "Learning Identity-Invariant Motion Representations for Cross-ID Face Reenactment." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020. doi:10.1109/CVPR42600.2020.00711Markdown
[Huang et al. "Learning Identity-Invariant Motion Representations for Cross-ID Face Reenactment." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.](https://mlanthology.org/cvpr/2020/huang2020cvpr-learning/) doi:10.1109/CVPR42600.2020.00711BibTeX
@inproceedings{huang2020cvpr-learning,
title = {{Learning Identity-Invariant Motion Representations for Cross-ID Face Reenactment}},
author = {Huang, Po-Hsiang and Yang, Fu-En and Wang, Yu-Chiang Frank},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2020},
doi = {10.1109/CVPR42600.2020.00711},
url = {https://mlanthology.org/cvpr/2020/huang2020cvpr-learning/}
}