论文标题

自适应学习从聚焦和散落的图像对中演示

Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs

论文作者

Liu, Lin, Yuan, Shanxin, Liu, Jianzhuang, Bao, Liping, Slabaugh, Gregory, Tian, Qi

论文摘要

Moire工件在数字摄影中很常见,这是由于高频场景内容与相机的颜色滤镜阵列之间的干扰所致。在大规模数据集中培训的现有基于深度学习的演示方法在处理各种复杂的Moire模式方面受到限制,主要关注数字显示器拍摄的照片的演示。此外,很难在自然场景中获得无摩尔地面真相,但需要进行训练。在本文中,我们提出了一种自适应学习方法,用于借助额外的无偶刻录的无摩尔模糊图像来示例高频图像。给定带有Moire工件和无Moire的模糊图像降解的图像,我们的网络预测了无摩尔的清洁图像和具有自适应策略的模糊内核,而无需明确的训练阶段,而不是执行测试时间适应。我们的模型有两个子网络,并在迭代上工作。在每次迭代期间,一个子网将Moire图像作为输入,删除Moire模式并恢复图像细节,而另一个子网络从模糊图像中估算了模糊内核。两个子网络共同优化。广泛的实验表明,我们的方法表现优于最先进的方法,并且可以产生高质量的演示结果。它可以很好地概括删除由显示屏幕引起的摩尔文物的任务。此外,我们构建了一个新的Moire数据集,包括带有屏幕和纹理Moire文物的图像。据我们所知,这是第一个具有真实纹理Moire模式的数据集。

Moire artifacts are common in digital photography, resulting from the interference between high-frequency scene content and the color filter array of the camera. Existing deep learning-based demoireing methods trained on large scale datasets are limited in handling various complex moire patterns, and mainly focus on demoireing of photos taken of digital displays. Moreover, obtaining moire-free ground-truth in natural scenes is difficult but needed for training. In this paper, we propose a self-adaptive learning method for demoireing a high-frequency image, with the help of an additional defocused moire-free blur image. Given an image degraded with moire artifacts and a moire-free blur image, our network predicts a moire-free clean image and a blur kernel with a self-adaptive strategy that does not require an explicit training stage, instead performing test-time adaptation. Our model has two sub-networks and works iteratively. During each iteration, one sub-network takes the moire image as input, removing moire patterns and restoring image details, and the other sub-network estimates the blur kernel from the blur image. The two sub-networks are jointly optimized. Extensive experiments demonstrate that our method outperforms state-of-the-art methods and can produce high-quality demoired results. It can generalize well to the task of removing moire artifacts caused by display screens. In addition, we build a new moire dataset, including images with screen and texture moire artifacts. As far as we know, this is the first dataset with real texture moire patterns.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源