StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation

Abstract

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style parameters, is significantly more disentangled than the other intermediate latent spaces explored by previous works. Next, we describe a method for discovering a large collection of style channels, each of which is shown to control a distinct visual attribute in a highly localized and disentangled manner. Third, we propose a simple method for identifying style channels that control a specific attribute, using a pretrained classifier or a small number of example images. Manipulation of visual attributes via these StyleSpace controls is shown to be better disentangled than via those proposed in previous works. To show this, we make use of a newly proposed Attribute Dependency metric. Finally, we demonstrate the applicability of StyleSpace controls to the manipulation of real images. Our findings pave the way to semantically meaningful and well-disentangled image manipulations via simple and intuitive interfaces.

Cite

Text

Wu et al. "StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation." Conference on Computer Vision and Pattern Recognition, 2021. doi:10.1109/CVPR46437.2021.01267

Markdown

[Wu et al. "StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation." Conference on Computer Vision and Pattern Recognition, 2021.](https://mlanthology.org/cvpr/2021/wu2021cvpr-stylespace/) doi:10.1109/CVPR46437.2021.01267

BibTeX

@inproceedings{wu2021cvpr-stylespace,
  title     = {{StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation}},
  author    = {Wu, Zongze and Lischinski, Dani and Shechtman, Eli},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2021},
  pages     = {12863-12872},
  doi       = {10.1109/CVPR46437.2021.01267},
  url       = {https://mlanthology.org/cvpr/2021/wu2021cvpr-stylespace/}
}