论文标题
SVD-GCN:简化的图形卷积范式供推荐
SVD-GCN: A Simplified Graph Convolution Paradigm for Recommendation
论文作者
论文摘要
随着图形卷积网络(GCN)的巨大成功,它们已被广泛应用于推荐系统,并显示出有希望的性能。但是,大多数基于GCN的方法都严格地坚持使用常见的GCN学习范式,并受到两个局限性:(1)由于高计算成本和慢速培训收敛而导致的可伸缩性有限; (2)臭名昭著的过度光滑问题,它降低了作为堆叠图卷积层的性能。我们认为上述局限性是由于对基于GCN的方法的深入了解所致。为此,我们首先研究了什么设计使GCN有效推荐。通过简化LightGCN,我们显示了基于GCN的基于GCN和低级别方法(例如单数值分解(SVD)和矩阵分解(MF)之间的密切联系,其中堆叠图形卷积层是通过强调(抑制)组件的较大(较小)单个值来学习低级表示(抑制)组件。基于此观察结果,我们用灵活的截短SVD替换了基于GCN的方法的核心设计,并提出了一种简化的GCN学习范式称为SVD-GCN,该范式仅利用$ k $ k $ - 最大的单数矢量来推荐。为了减轻过度平滑的问题,我们提出了一个重新归一化的技巧来调整奇异价值差距,从而显着改善。在三个现实世界数据集上进行的广泛实验表明,我们提出的SVD-GCN不仅显着胜过最先进的,而且在LightGCN和MF上分别实现了超过100倍和10倍的速度。
With the tremendous success of Graph Convolutional Networks (GCNs), they have been widely applied to recommender systems and have shown promising performance. However, most GCN-based methods rigorously stick to a common GCN learning paradigm and suffer from two limitations: (1) the limited scalability due to the high computational cost and slow training convergence; (2) the notorious over-smoothing issue which reduces performance as stacking graph convolution layers. We argue that the above limitations are due to the lack of a deep understanding of GCN-based methods. To this end, we first investigate what design makes GCN effective for recommendation. By simplifying LightGCN, we show the close connection between GCN-based and low-rank methods such as Singular Value Decomposition (SVD) and Matrix Factorization (MF), where stacking graph convolution layers is to learn a low-rank representation by emphasizing (suppressing) components with larger (smaller) singular values. Based on this observation, we replace the core design of GCN-based methods with a flexible truncated SVD and propose a simplified GCN learning paradigm dubbed SVD-GCN, which only exploits $K$-largest singular vectors for recommendation. To alleviate the over-smoothing issue, we propose a renormalization trick to adjust the singular value gap, resulting in significant improvement. Extensive experiments on three real-world datasets show that our proposed SVD-GCN not only significantly outperforms state-of-the-arts but also achieves over 100x and 10x speedups over LightGCN and MF, respectively.