Combating Bilateral Edge Noise for Robust Link Prediction

Abstract

Although link prediction on graphs has achieved great success with the development of graph neural networks (GNNs), the potential robustness under the edge noise is still less investigated. To close this gap, we first conduct an empirical study to disclose that the edge noise bilaterally perturbs both input topology and target label, yielding severe performance degradation and representation collapse. To address this dilemma, we propose an information-theory-guided principle, Robust Graph Information Bottleneck (RGIB), to extract reliable supervision signals and avoid representation collapse. Different from the basic information bottleneck, RGIB further decouples and balances the mutual dependence among graph topology, target labels, and representation, building new learning objectives for robust representation against the bilateral noise. Two instantiations, RGIB-SSL and RGIB-REP, are explored to leverage the merits of different methodologies, i.e., self-supervised learning and data reparameterization, for implicit and explicit data denoising, respectively. Extensive experiments on six datasets and three GNNs with diverse noisy scenarios verify the effectiveness of our RGIB instantiations. The code is publicly available at: https://github.com/tmlr-group/RGIB.

Cite

Text

Zhou et al. "Combating Bilateral Edge Noise for Robust Link Prediction." Neural Information Processing Systems, 2023.

Markdown

[Zhou et al. "Combating Bilateral Edge Noise for Robust Link Prediction." Neural Information Processing Systems, 2023.](https://mlanthology.org/neurips/2023/zhou2023neurips-combating-a/)

BibTeX

@inproceedings{zhou2023neurips-combating-a,
  title     = {{Combating Bilateral Edge Noise for Robust Link Prediction}},
  author    = {Zhou, Zhanke and Yao, Jiangchao and Liu, Jiaxu and Guo, Xiawei and Yao, Quanming and He, Li and Wang, Liang and Zheng, Bo and Han, Bo},
  booktitle = {Neural Information Processing Systems},
  year      = {2023},
  url       = {https://mlanthology.org/neurips/2023/zhou2023neurips-combating-a/}
}