论文标题
通过签名属性向量的连续和多样化的图像到图像翻译
Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors
论文作者
论文摘要
最近的图像到图像(I2I)翻译算法着重于学习从源到目标域的映射。但是,在文献中综合了两个领域之间的中间结果的连续翻译问题在文献中尚未得到充分研究。产生平滑的中间结果序列桥接了两个不同域的间隙,从而促进了跨域的变形效果。现有的I2i方法仅限于域内或确定性域间连续翻译。在这项工作中,我们提出了一个有效签名的属性向量,该向量可以在各个领域的各种映射路径上进行连续翻译。特别是,我们引入了所有域共享的统一属性空间,该空间利用符号操作来编码域信息,从而允许在不同域的属性向量上进行插值。为了提高连续翻译结果的视觉质量,我们在两个标志对称属性向量之间产生轨迹,并利用沿轨迹插值结果的域信息进行对抗训练。我们在多种I2I翻译任务上评估了提出的方法。定性和定量结果都表明,该框架对最新方法产生了更高质量的连续翻译结果。
Recent image-to-image (I2I) translation algorithms focus on learning the mapping from a source to a target domain. However, the continuous translation problem that synthesizes intermediate results between two domains has not been well-studied in the literature. Generating a smooth sequence of intermediate results bridges the gap of two different domains, facilitating the morphing effect across domains. Existing I2I approaches are limited to either intra-domain or deterministic inter-domain continuous translation. In this work, we present an effectively signed attribute vector, which enables continuous translation on diverse mapping paths across various domains. In particular, we introduce a unified attribute space shared by all domains that utilize the sign operation to encode the domain information, thereby allowing the interpolation on attribute vectors of different domains. To enhance the visual quality of continuous translation results, we generate a trajectory between two sign-symmetrical attribute vectors and leverage the domain information of the interpolated results along the trajectory for adversarial training. We evaluate the proposed method on a wide range of I2I translation tasks. Both qualitative and quantitative results demonstrate that the proposed framework generates more high-quality continuous translation results against the state-of-the-art methods.