LightGCL: Simple yet Effective Graph Contrastive Learning for Recommendation

Abstract

Graph neural network (GNN) is a powerful learning approach for graph-based recommender systems. Recently, GNNs integrated with contrastive learning have shown superior performance in recommendation with their data augmentation schemes, aiming at dealing with highly sparse data. Despite their success, most existing graph contrastive learning methods either perform stochastic augmentation (e.g., node/edge perturbation) on the user-item interaction graph, or rely on the heuristic-based augmentation techniques (e.g., user clustering) for generating contrastive views. We argue that these methods cannot well preserve the intrinsic semantic structures and are easily biased by the noise perturbation. In this paper, we propose a simple yet effective graph contrastive learning paradigm LightGCL that mitigates these issues impairing the generality and robustness of CL-based recommenders. Our model exclusively utilizes singular value decomposition for contrastive augmentation, which enables the unconstrained structural refinement with global collaborative relation modeling. Experiments conducted on several benchmark datasets demonstrate the significant improvement in performance of our model over the state-of-the-arts. Further analyses demonstrate the superiority of LightGCL's robustness against data sparsity and popularity bias. The source code of our model is available at https://github.com/HKUDS/LightGCL.

Cite

Text

Cai et al. "LightGCL: Simple yet Effective Graph Contrastive Learning for Recommendation." International Conference on Learning Representations, 2023.

Markdown

[Cai et al. "LightGCL: Simple yet Effective Graph Contrastive Learning for Recommendation." International Conference on Learning Representations, 2023.](https://mlanthology.org/iclr/2023/cai2023iclr-lightgcl/)

BibTeX

@inproceedings{cai2023iclr-lightgcl,
  title     = {{LightGCL: Simple yet Effective Graph Contrastive Learning for Recommendation}},
  author    = {Cai, Xuheng and Huang, Chao and Xia, Lianghao and Ren, Xubin},
  booktitle = {International Conference on Learning Representations},
  year      = {2023},
  url       = {https://mlanthology.org/iclr/2023/cai2023iclr-lightgcl/}
}