论文标题
基于频率图的超分辨率图像的无参考深度学习质量评估方法
A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps
论文作者
论文摘要
为了支持迫切需要高分辨率(HR)图像的应用程序方案,开发了各种单个图像超分辨率(SISR)算法。但是,SISR是一个不良的逆问题,它可能会将诸如纹理转移,模糊等诸如重建图像等伪像,因此有必要评估超分辨率图像(SRIS)的质量。请注意,大多数现有的图像质量评估(IQA)方法都是用于合成扭曲的图像的,这可能对SRI不起作用,因为它们的扭曲更加多样化和复杂。因此,在本文中,我们提出了一种基于频率图的无参考图像质量评估方法,因为SISR算法引起的伪像对频率信息非常敏感。具体而言,我们首先通过使用SOBEL操作员和分段光滑的图像近似来获得SRI的高频图(HM)和低频图(LM)。然后,使用两个流网络来提取两个频率图的质量感知特征。最后,使用完全连接的图层将功能回归单个质量值。实验结果表明,我们的方法的表现均优于所选三种超分辨率质量评估(SRQA)数据库的IQA模型。
To support the application scenarios where high-resolution (HR) images are urgently needed, various single image super-resolution (SISR) algorithms are developed. However, SISR is an ill-posed inverse problem, which may bring artifacts like texture shift, blur, etc. to the reconstructed images, thus it is necessary to evaluate the quality of super-resolution images (SRIs). Note that most existing image quality assessment (IQA) methods were developed for synthetically distorted images, which may not work for SRIs since their distortions are more diverse and complicated. Therefore, in this paper, we propose a no-reference deep-learning image quality assessment method based on frequency maps because the artifacts caused by SISR algorithms are quite sensitive to frequency information. Specifically, we first obtain the high-frequency map (HM) and low-frequency map (LM) of SRI by using Sobel operator and piecewise smooth image approximation. Then, a two-stream network is employed to extract the quality-aware features of both frequency maps. Finally, the features are regressed into a single quality value using fully connected layers. The experimental results show that our method outperforms all compared IQA models on the selected three super-resolution quality assessment (SRQA) databases.