论文标题
从脸到自然形象:学习盲图像超分辨率的真正退化
From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution
论文作者
论文摘要
如何设计适当的训练对对于超出分辨率的现实世界低质量(LQ)图像至关重要,这遇到了获得配对的地面真相高质量(HQ)图像或合成光真实的降解LQ观察的困难。最近的工作主要集中于用手工制作或估计的降解参数建模降解,但是这些参数无法模拟复杂的现实世界降解类型,从而导致质量有限的改进。值得注意的是,通过利用其强大的结构先验,可以通过光真逼真的纹理恢复与自然图像相同的降解过程的LQ面图像。这促使我们使用现实世界中的LQ面图像及其还原的HQ对应物来建模复杂的现实世界降级(即Redegnet),然后将其传输到HQ自然图像以合成其现实的LQ对应物。通过将这些配对的HQ-LQ面图像作为输入,以明确预测降解感和内容无关的表示,我们可以控制退化的图像生成,然后随后将这些降解表示从脸部转移到自然图像,以合成降级的LQ自然图像。实验表明,我们的重编号可以从面部图像中学习真正的退化过程。接受我们合成对的训练的恢复网络对SOTA表现出色。更重要的是,我们的方法通过从面部部分学习其降解表示来处理现实世界中复杂方案的新方法,可用于显着提高非种族区域的质量。源代码可在https://github.com/csxmli2016/redegnet上找到。
How to design proper training pairs is critical for super-resolving real-world low-quality (LQ) images, which suffers from the difficulties in either acquiring paired ground-truth high-quality (HQ) images or synthesizing photo-realistic degraded LQ observations. Recent works mainly focus on modeling the degradation with handcrafted or estimated degradation parameters, which are however incapable to model complicated real-world degradation types, resulting in limited quality improvement. Notably, LQ face images, which may have the same degradation process as natural images, can be robustly restored with photo-realistic textures by exploiting their strong structural priors. This motivates us to use the real-world LQ face images and their restored HQ counterparts to model the complex real-world degradation (namely ReDegNet), and then transfer it to HQ natural images to synthesize their realistic LQ counterparts. By taking these paired HQ-LQ face images as inputs to explicitly predict the degradation-aware and content-independent representations, we could control the degraded image generation, and subsequently transfer these degradation representations from face to natural images to synthesize the degraded LQ natural images. Experiments show that our ReDegNet can well learn the real degradation process from face images. The restoration network trained with our synthetic pairs performs favorably against SOTAs. More importantly, our method provides a new way to handle the real-world complex scenarios by learning their degradation representations from the facial portions, which can be used to significantly improve the quality of non-facial areas. The source code is available at https://github.com/csxmli2016/ReDegNet.