Zero-Shot Generalization of GNNs over Distinct Attribute Domains

Abstract

There are no known graph machine learning methods that can zero-shot generalize across attributed graphs with different node attribute domains. For instance, no method can perform zero-shot link prediction by pretraining on online appliance store datasets (with node attributes such as brand, model, capacity, dimension, has ice maker, energy rating for refrigerators) and zero-shot at test on an electronics store dataset for smartphones (with attributes such as processor type, display type, storage, and battery capacity). In this work, we leverage concepts in statistical theory to design STAGE, a universally applicable approach for encoding node attributes in _any GNN_ that facilitates such generalization. Empirically, we show that STAGE outperforms its natural baselines and can accurately make predictions when presented with completely new feature domains.

Cite

Text

Shen et al. "Zero-Shot Generalization of GNNs over Distinct Attribute Domains." ICML 2024 Workshops: FM-Wild, 2024.

Markdown

[Shen et al. "Zero-Shot Generalization of GNNs over Distinct Attribute Domains." ICML 2024 Workshops: FM-Wild, 2024.](https://mlanthology.org/icmlw/2024/shen2024icmlw-zeroshot/)

BibTeX

@inproceedings{shen2024icmlw-zeroshot,
  title     = {{Zero-Shot Generalization of GNNs over Distinct Attribute Domains}},
  author    = {Shen, Yangyi and Bevilacqua, Beatrice and Robinson, Joshua and Kanatsoulis, Charilaos and Leskovec, Jure and Ribeiro, Bruno},
  booktitle = {ICML 2024 Workshops: FM-Wild},
  year      = {2024},
  url       = {https://mlanthology.org/icmlw/2024/shen2024icmlw-zeroshot/}
}