论文标题

使用伪套房的不配对图像超分辨率

Unpaired Image Super-Resolution using Pseudo-Supervision

论文作者

Maeda, Shunta

论文摘要

在大多数基于学习的图像超分辨率(SR)的研究中,配对训练数据集是通过缩小预定操作(例如Bicubic)的高尺度高分辨率(HR)图像来创建的。但是,这些方法无法超级溶解现实世界的低分辨率(LR)图像,为此,降解过程更加复杂且未知。在本文中,我们使用不需要成对/对齐的训练数据集的生成对抗网络提出了一种不成对的SR方法。我们的网络由未配对的内核/噪声校正网络和伪配对的SR网络组成。校正网络消除了噪声并调整输入的LR图像的内核;然后,校正后的清洁LR图像由SR网络抬高。在训练阶段,校正网络还从输入的HR图像中产生了伪清洁的LR图像,然后以配对的方式学习了从伪清洁LR图像到输入的HR图像的映射。由于我们的SR网络独立于校正网络,因此可以将现有的网络体系结构和像素损耗功能与所提出的框架集成在一起。关于不同数据集的实验表明,所提出的方法优于未配对SR问题的现有解决方案。

In most studies on learning-based image super-resolution (SR), the paired training dataset is created by downscaling high-resolution (HR) images with a predetermined operation (e.g., bicubic). However, these methods fail to super-resolve real-world low-resolution (LR) images, for which the degradation process is much more complicated and unknown. In this paper, we propose an unpaired SR method using a generative adversarial network that does not require a paired/aligned training dataset. Our network consists of an unpaired kernel/noise correction network and a pseudo-paired SR network. The correction network removes noise and adjusts the kernel of the inputted LR image; then, the corrected clean LR image is upscaled by the SR network. In the training phase, the correction network also produces a pseudo-clean LR image from the inputted HR image, and then a mapping from the pseudo-clean LR image to the inputted HR image is learned by the SR network in a paired manner. Because our SR network is independent of the correction network, well-studied existing network architectures and pixel-wise loss functions can be integrated with the proposed framework. Experiments on diverse datasets show that the proposed method is superior to existing solutions to the unpaired SR problem.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源