论文标题

具有有条件独立像素合成的图像发生器

Image Generators with Conditionally-Independent Pixel Synthesis

论文作者

Anokhin, Ivan, Demochkin, Kirill, Khakhulin, Taras, Sterkin, Gleb, Lempitsky, Victor, Korzhenkov, Denis

论文摘要

现有的图像发电机网络在很大程度上依赖于空间卷积,并且可以选择地自我发挥作用块,以便以粗略的方式逐渐合成图像。在这里,我们提出了一个用于图像生成器的新体系结构,其中每个像素的颜色值在随机潜在向量的值和该像素的坐标的情况下独立计算。在合成过程中,没有涉及跨像素的信息的空间卷积或类似的操作。我们以对抗性训练时分析了此类发电机的建模功能,并观察新的发电机以达到与最先进的卷积发生器相似的发电质量。我们还研究了新体系结构独有的几个有趣属性。

Existing image generator networks rely heavily on spatial convolutions and, optionally, self-attention blocks in order to gradually synthesize images in a coarse-to-fine manner. Here, we present a new architecture for image generators, where the color value at each pixel is computed independently given the value of a random latent vector and the coordinate of that pixel. No spatial convolutions or similar operations that propagate information across pixels are involved during the synthesis. We analyze the modeling capabilities of such generators when trained in an adversarial fashion, and observe the new generators to achieve similar generation quality to state-of-the-art convolutional generators. We also investigate several interesting properties unique to the new architecture.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源