ML Anthology

Example-Guided Style-Consistent Image Synthesis from Semantic Labeling

Miao Wang, Guo-Ye Yang, Ruilong Li, Run-Ze Liang, Song-Hai Zhang, Peter M. Hall, Shi-Min Hu
CVPR 2019
doi:10.1109/CVPR.2019.00159 /cvpr/2019/wang2019cvpr-exampleguided/

Abstract

Example-guided image synthesis aims to synthesize an image from a semantic label map and an exemplary image indicating style. We use the term "style" in this problem to refer to implicit characteristics of images, for example: in portraits "style" includes gender, racial identity, age, hairstyle; in full body pictures it includes clothing; in street scenes it refers to weather and time of day and such like. A semantic label map in these cases indicates facial expression, full body pose, or scene segmentation. We propose a solution to the example-guided image synthesis problem using conditional generative adversarial networks with style consistency. Our key contributions are (i) a novel style consistency discriminator to determine whether a pair of images are consistent in style; (ii) an adaptive semantic consistency loss; and (iii) a training data sampling strategy, for synthesizing style-consistent results to the exemplar. We demonstrate the efficiency of our method on face, dance and street view synthesis tasks.

PDF CVPR Semantic Scholar

Cite

Text

Wang et al. "Example-Guided Style-Consistent Image Synthesis from Semantic Labeling." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019. doi:10.1109/CVPR.2019.00159

Markdown

[Wang et al. "Example-Guided Style-Consistent Image Synthesis from Semantic Labeling." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.](https://mlanthology.org/cvpr/2019/wang2019cvpr-exampleguided/) doi:10.1109/CVPR.2019.00159

BibTeX

@inproceedings{wang2019cvpr-exampleguided,
  title     = {{Example-Guided Style-Consistent Image Synthesis from Semantic Labeling}},
  author    = {Wang, Miao and Yang, Guo-Ye and Li, Ruilong and Liang, Run-Ze and Zhang, Song-Hai and Hall, Peter M. and Hu, Shi-Min},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2019},
  doi       = {10.1109/CVPR.2019.00159},
  url       = {https://mlanthology.org/cvpr/2019/wang2019cvpr-exampleguided/}
}