Image Generators with Conditionally-Independent Pixel Synthesis

Abstract

Existing image generator networks rely heavily on spatial convolutions and, optionally, self-attention blocks in order to gradually synthesize images in a coarse-to-fine manner. Here, we present a new architecture for image generators, where the color value at each pixel is computed independently given the value of a random latent vector and the coordinate of that pixel. No spatial convolutions or similar operations that propagate information across pixels are involved during the synthesis. We analyze the modeling capabilities of such generators when trained in an adversarial fashion, and observe the new generators to achieve similar generation quality to state-of-the-art convolutional generators. We also investigate several interesting properties unique to the new architecture.

Cite

Text

Anokhin et al. "Image Generators with Conditionally-Independent Pixel Synthesis." Conference on Computer Vision and Pattern Recognition, 2021. doi:10.1109/CVPR46437.2021.01405

Markdown

[Anokhin et al. "Image Generators with Conditionally-Independent Pixel Synthesis." Conference on Computer Vision and Pattern Recognition, 2021.](https://mlanthology.org/cvpr/2021/anokhin2021cvpr-image/) doi:10.1109/CVPR46437.2021.01405

BibTeX

@inproceedings{anokhin2021cvpr-image,
  title     = {{Image Generators with Conditionally-Independent Pixel Synthesis}},
  author    = {Anokhin, Ivan and Demochkin, Kirill and Khakhulin, Taras and Sterkin, Gleb and Lempitsky, Victor and Korzhenkov, Denis},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2021},
  pages     = {14278-14287},
  doi       = {10.1109/CVPR46437.2021.01405},
  url       = {https://mlanthology.org/cvpr/2021/anokhin2021cvpr-image/}
}