Mitigating Over-Smoothing in Graph Neural Networks via Separation Coefficient-Guided Adaptive Graph Structure Adjustment

Abstract

As the number of layers in Graph Neural Networks (GNNs) increases, over-smoothing becomes more severe, causing intra-class feature distances to shrink, while heterogeneous representations tend to converge. Most existing methods attempt to address this issue by employing heuristic shortcut mechanisms or optimizing objectives to constrain inter-class feature differences. However, these approaches fail to establish a theoretical connection between message passing and the variation in inter-class feature differences, making it challenging to design methods that target the key influencing factors. To address this gap, this paper first introduces the concept of the separation coefficient, which quantifies the contraction of feature distances between classes during multi-layer message passing. Based on this theory, we propose a low-complexity, pluggable, pseudo-label-based adaptive graph structure adjustment method. This approach effectively enhances the separation coefficient of inter-class features while maintaining intra-class compactness, thereby alleviating the convergence of heterogeneous representations caused by multi-layer aggregation. Experimental results demonstrate that the proposed method significantly improves the discriminability of node representations and enhances node classification performance across various datasets and foundational models.

Cite

Text

Meng et al. "Mitigating Over-Smoothing in Graph Neural Networks via Separation Coefficient-Guided Adaptive Graph Structure Adjustment." International Joint Conference on Artificial Intelligence, 2025. doi:10.24963/IJCAI.2025/663

Markdown

[Meng et al. "Mitigating Over-Smoothing in Graph Neural Networks via Separation Coefficient-Guided Adaptive Graph Structure Adjustment." International Joint Conference on Artificial Intelligence, 2025.](https://mlanthology.org/ijcai/2025/meng2025ijcai-mitigating/) doi:10.24963/IJCAI.2025/663

BibTeX

@inproceedings{meng2025ijcai-mitigating,
  title     = {{Mitigating Over-Smoothing in Graph Neural Networks via Separation Coefficient-Guided Adaptive Graph Structure Adjustment}},
  author    = {Meng, Hanyang and Yang, Jielong and Peng, Li},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2025},
  pages     = {5959-5966},
  doi       = {10.24963/IJCAI.2025/663},
  url       = {https://mlanthology.org/ijcai/2025/meng2025ijcai-mitigating/}
}