What Makes Tom Hanks Look like Tom Hanks

Abstract

We reconstruct a controllable model of a person from a large photo collection that captures his or her persona, i.e., physical appearance and behavior. The ability to operate on unstructured photo collections enables modeling a huge number of people, including celebrities and other well photographed people without requiring them to be scanned. Moreover, we show the ability to drive or puppeteer the captured person B using any other video of a different person A. In this scenario, B acts out the role of person A, but retains his/her own personality and character. Our system is based on a novel combination of 3D face reconstruction, tracking, alignment, and multi-texture modeling, applied to the puppeteering problem. We demonstrate convincing results on a large variety of celebrities derived from Internet imagery and video.

Cite

Text

Suwajanakorn et al. "What Makes Tom Hanks Look like Tom Hanks." International Conference on Computer Vision, 2015. doi:10.1109/ICCV.2015.450

Markdown

[Suwajanakorn et al. "What Makes Tom Hanks Look like Tom Hanks." International Conference on Computer Vision, 2015.](https://mlanthology.org/iccv/2015/suwajanakorn2015iccv-makes/) doi:10.1109/ICCV.2015.450

BibTeX

@inproceedings{suwajanakorn2015iccv-makes,
  title     = {{What Makes Tom Hanks Look like Tom Hanks}},
  author    = {Suwajanakorn, Supasorn and Seitz, Steven M. and Kemelmacher-Shlizerman, Ira},
  booktitle = {International Conference on Computer Vision},
  year      = {2015},
  doi       = {10.1109/ICCV.2015.450},
  url       = {https://mlanthology.org/iccv/2015/suwajanakorn2015iccv-makes/}
}