Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars

Egor Zakharov, Aleksei Ivakhnenko, Aliaksandra Shysheya, Victor Lempitsky

ECCV 2020

doi:10.1007/978-3-030-58610-2_31 /eccv/2020/zakharov2020eccv-fast/

Abstract

We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized by a small neural network. The second layer is defined by a pose-independent texture image that contains high-frequency details. The texture image is generated offline, warped and added to the coarse image to ensure a high effective resolution of synthesized head views. We compare our system to analogous state-of-the-art systems in terms of visual quality and speed. The experiments show significant inference speedup over previous neural head avatar models for a given visual quality. We also report on a real-time smartphone-based implementation of our system.

PDF ECCV Semantic Scholar

Cite

Text

Zakharov et al. "Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars." Proceedings of the European Conference on Computer Vision (ECCV), 2020. doi:10.1007/978-3-030-58610-2_31

Markdown

[Zakharov et al. "Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars." Proceedings of the European Conference on Computer Vision (ECCV), 2020.](https://mlanthology.org/eccv/2020/zakharov2020eccv-fast/) doi:10.1007/978-3-030-58610-2_31

BibTeX

@inproceedings{zakharov2020eccv-fast,
  title     = {{Fast Bi-Layer Neural Synthesis of One-Shot Realistic Head Avatars}},
  author    = {Zakharov, Egor and Ivakhnenko, Aleksei and Shysheya, Aliaksandra and Lempitsky, Victor},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2020},
  doi       = {10.1007/978-3-030-58610-2_31},
  url       = {https://mlanthology.org/eccv/2020/zakharov2020eccv-fast/}
}