Hyperbolic Contrastive Learning with Model-Augmentation for Knowledge-Aware Recommendation

Abstract

Benefiting from the effectiveness of graph neural networks (GNNs) and contrastive learning, GNN-based contrastive learning has become mainstream for knowledge-aware recommendation. However, most existing contrastive learning-based methods have difficulties in effectively capturing the underlying hierarchical structure within user-item bipartite graphs and knowledge graphs. Moreover, they commonly generate positive samples for contrastive learning by perturbing the graph structure, which may lead to a shift in user preference learning. To overcome these limitations, we propose hyperbolic contrastive learning with model-augmentation for knowledge-aware recommendation. To capture the intrinsic hierarchical graph structures, we first design a novel Lorentzian knowledge aggregation mechanism, which enables more effective representations of users and items. Then, we propose three model-level augmentation techniques to assist Hyperbolic contrastive learning. Different from the classical structure-level augmentation (e.g., edge dropping), the proposed model-augmentations can avoid preference shifts between the augmented positive pair. Finally, we conduct extensive experiments to demonstrate the superiority (maximum improvement of $11.03\%$) of proposed methods over existing baselines.

Cite

Text

Sun and Ma. "Hyperbolic Contrastive Learning with Model-Augmentation for Knowledge-Aware Recommendation." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024. doi:10.1007/978-3-031-70371-3_12

Markdown

[Sun and Ma. "Hyperbolic Contrastive Learning with Model-Augmentation for Knowledge-Aware Recommendation." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024.](https://mlanthology.org/ecmlpkdd/2024/sun2024ecmlpkdd-hyperbolic/) doi:10.1007/978-3-031-70371-3_12

BibTeX

@inproceedings{sun2024ecmlpkdd-hyperbolic,
  title     = {{Hyperbolic Contrastive Learning with Model-Augmentation for Knowledge-Aware Recommendation}},
  author    = {Sun, Shengyin and Ma, Chen},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2024},
  pages     = {199-217},
  doi       = {10.1007/978-3-031-70371-3_12},
  url       = {https://mlanthology.org/ecmlpkdd/2024/sun2024ecmlpkdd-hyperbolic/}
}