论文标题
散射GCN:克服图形卷积网络中的过度平滑度
Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks
论文作者
论文摘要
图形卷积网络(GCN)通过提取结构感知特征来处理图形数据时显示出令人鼓舞的结果。这引起了几何深度学习的广泛工作,重点是设计网络体系结构,以确保神经元激活符合输入图中的规则性模式。但是,在大多数情况下,仅通过考虑相邻节点之间激活的相似性来解释图形结构,这限制了这种方法在图中区分节点的功能。在这里,我们建议通过几何散射变换和残留卷积来增强常规GCN。前者启用了图形信号的带通滤波,从而减轻了GCN中经常遇到的所谓过度平滑尺寸,而后者则是为了清除高频噪声的产生特征。我们建立了所提出的散射GCN的优势,并建立了理论上的结果,以建立散射和GCN特征的互补益处,以及实验结果,显示了与领先的图形神经网络相比,我们方法的益处是针对半抑制节点分类的领先图形神经网络,包括最近提出的GAT网络,包括使用图形注意机制削弱过度厚度的GAT网络。
Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that ensure neuron activations conform to regularity patterns within the input graph. However, in most cases the graph structure is only accounted for by considering the similarity of activations between adjacent nodes, which limits the capabilities of such methods to discriminate between nodes in a graph. Here, we propose to augment conventional GCNs with geometric scattering transforms and residual convolutions. The former enables band-pass filtering of graph signals, thus alleviating the so-called oversmoothing often encountered in GCNs, while the latter is introduced to clear the resulting features of high-frequency noise. We establish the advantages of the presented Scattering GCN with both theoretical results establishing the complementary benefits of scattering and GCN features, as well as experimental results showing the benefits of our method compared to leading graph neural networks for semi-supervised node classification, including the recently proposed GAT network that typically alleviates oversmoothing using graph attention mechanisms.