论文标题

完整的RGB明显差异(JND)建模

Full RGB Just Noticeable Difference (JND) Modelling

论文作者

Jin, Jian, Yu, Dong, Lin, Weisi, Meng, Lili, Wang, Hao, Zhang, Huaxiang

论文摘要

仅仅明显的差异(JND)在多媒体信号处理中具有许多应用程序,尤其是对于视觉数据处理的最新处理。通常,它被定义为人类可以透视的最小视觉内容变化,该内容已经研究了数十年。但是,大多数现有方法仅着眼于JND建模的亮度成分,而只是将色彩成分视为亮度的缩放版本。在本文中,我们提出了一个JND模型来通过考虑完整的RGB通道的特征来生成JND,称为RGB-JND。为此,提出了RGB-JND-NET,其中使用完整的RGB通道中的视觉内容用于为JND生成提取功能。为了监督JND一代,开发了自适应图像质量评估组合(AIC)。此外,RDB-JND-NET还通过自动挖掘视觉注意力与JND之间的潜在关系来考虑视觉关注,该关系进一步用于约束JND空间分布。据我们所知,这是对全彩色空间的JND建模进行仔细研究的第一项工作。实验结果表明,RGB-JND-NET模型的表现优于相关的最新JND模型。此外,根据所提出的模型的实验结果,红色和蓝色通道的JND大于绿色通道的JND,这表明在红色和蓝色通道中可以耐受更多的变化,这与众所周知的事实是,与红色和蓝色相比,人类视觉系统对绿色通道更敏感。

Just Noticeable Difference (JND) has many applications in multimedia signal processing, especially for visual data processing up to date. It's generally defined as the minimum visual content changes that the human can perspective, which has been studied for decades. However, most of the existing methods only focus on the luminance component of JND modelling and simply regard chrominance components as scaled versions of luminance. In this paper, we propose a JND model to generate the JND by taking the characteristics of full RGB channels into account, termed as the RGB-JND. To this end, an RGB-JND-NET is proposed, where the visual content in full RGB channels is used to extract features for JND generation. To supervise the JND generation, an adaptive image quality assessment combination (AIC) is developed. Besides, the RDB-JND-NET also takes the visual attention into account by automatically mining the underlying relationship between visual attention and the JND, which is further used to constrain the JND spatial distribution. To the best of our knowledge, this is the first work on careful investigation of JND modelling for full-color space. Experimental results demonstrate that the RGB-JND-NET model outperforms the relevant state-of-the-art JND models. Besides, the JND of the red and blue channels are larger than that of the green one according to the experimental results of the proposed model, which demonstrates that more changes can be tolerated in the red and blue channels, in line with the well-known fact that the human visual system is more sensitive to the green channel in comparison with the red and blue ones.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源