论文标题
CVF-sid:自我监督图像deno的循环多变量函数,通过从图像中解散噪声
CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image
论文作者
论文摘要
最近,通过大规模数据集的强烈监督,对图像denosing取得了重大进展。但是,在每种特定情况下,获得良好的嘈杂清洁训练图对既复杂又昂贵。因此,在野外嘈杂的输入上应用常规监督的Denoising网络并不直接。尽管几项研究在没有强大的监督的情况下挑战了这个问题,但它们依赖于较不实际的假设,不能直接应用于实际情况。为了应对上述挑战,我们提出了一种基于循环多变量函数(CVF)模块的新颖而强大的自我监督的denoising方法,称为CVF-SID,并提供了一个自我监督的图像分散图像(SID)框架。 CVF模块可以输出输入的多个分解变量,并以循环方式将输出作为输入的组合。我们的CVF-SID可以通过利用各种自我监管的损失项来解散干净的图像和噪声图。与仅考虑信号无关的噪声模型的几种方法不同,我们还处理用于现实世界应用的信号依赖性噪声组件。此外,我们不依赖于对基本噪声分布的任何先前假设,从而使CVF-SID更适合对现实噪声。对现实世界数据集的广泛实验表明,CVF-SID实现了最先进的自我监管图像denoising绩效,并且与其他现有方法相媲美。该代码可从https://github.com/reyhanehne/cvf-sid_pytorch公开获得。
Recently, significant progress has been made on image denoising with strong supervision from large-scale datasets. However, obtaining well-aligned noisy-clean training image pairs for each specific scenario is complicated and costly in practice. Consequently, applying a conventional supervised denoising network on in-the-wild noisy inputs is not straightforward. Although several studies have challenged this problem without strong supervision, they rely on less practical assumptions and cannot be applied to practical situations directly. To address the aforementioned challenges, we propose a novel and powerful self-supervised denoising method called CVF-SID based on a Cyclic multi-Variate Function (CVF) module and a self-supervised image disentangling (SID) framework. The CVF module can output multiple decomposed variables of the input and take a combination of the outputs back as an input in a cyclic manner. Our CVF-SID can disentangle a clean image and noise maps from the input by leveraging various self-supervised loss terms. Unlike several methods that only consider the signal-independent noise models, we also deal with signal-dependent noise components for real-world applications. Furthermore, we do not rely on any prior assumptions about the underlying noise distribution, making CVF-SID more generalizable toward realistic noise. Extensive experiments on real-world datasets show that CVF-SID achieves state-of-the-art self-supervised image denoising performance and is comparable to other existing approaches. The code is publicly available from https://github.com/Reyhanehne/CVF-SID_PyTorch .