论文标题

学习高光谱图像超分辨率的空间光谱先验

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

论文作者

Jiang, Junjun, Sun, He, Liu, Xianming, Ma, Jiayi

论文摘要

最近,通过利用基于深卷积神经网络(DCNNS)的先进机器学习技术来实现单个灰色/RGB图像超分辨率重建任务,并通过利用先进的机器学习技术取得了重大进展。然而,由于高光谱图像中高维和复杂的光谱模式,技术发展的重点是单个高光图像超分辨率。在本文中,我们通过研究如何适应基于最先进的剩余学习的单个灰色/RGB图像超分辨率的方法来向前迈出一步,用于计算高效的单光谱图像超分辨率,称为SSPSR。具体而言,我们引入了空间谱的先验网络(SSPN),以充分利用空间信息和高光谱数据光谱之间的相关性。考虑到高光谱训练样本是稀缺的,并且高光谱图像数据的光谱维度非常高,因此训练一个稳定有效的深层网络是不算气的。因此,提出了组卷积(带有共享网络参数)和渐进的UPSMPLING框架。这不仅会由于高光谱数据的高维度而减轻特征提取的困难,而且还可以使训练过程更加稳定。为了利用空间和光谱之前,我们设计了一个空间谱块(SSB),该块由空间残留模块和光谱注意残留模块组成。一些高光谱图像的实验结果表明,所提出的SSPR方法增强了回收的高分辨率高光谱图像的细节,并且表现优于最先进的图像。源代码可在\ url {https://github.com/junjun-jiang/sspsr获得

Recently, single gray/RGB image super-resolution reconstruction task has been extensively studied and made significant progress by leveraging the advanced machine learning techniques based on deep convolutional neural networks (DCNNs). However, there has been limited technical development focusing on single hyperspectral image super-resolution due to the high-dimensional and complex spectral patterns in hyperspectral image. In this paper, we make a step forward by investigating how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches for computationally efficient single hyperspectral image super-resolution, referred as SSPSR. Specifically, we introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Considering that the hyperspectral training samples are scarce and the spectral dimension of hyperspectral image data is very high, it is nontrivial to train a stable and effective deep network. Therefore, a group convolution (with shared network parameters) and progressive upsampling framework is proposed. This will not only alleviate the difficulty in feature extraction due to high-dimension of the hyperspectral data, but also make the training process more stable. To exploit the spatial and spectral prior, we design a spatial-spectral block (SSB), which consists of a spatial residual module and a spectral attention residual module. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images, and outperforms state-of-the-arts. The source code is available at \url{https://github.com/junjun-jiang/SSPSR

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源