LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory
Abstract
Distribution shifts in recommender systems between training and testing in user-item interactions lead to inaccurate recommendations. Despite the promising performance of test-time adaptation technology in various domains, it still faces challenges in recommender systems due to the impracticality of fine-tuning models and the infeasibility of obtaining test-time labels. To address these challenges, we first propose a Test-Time Adaptation framework for Graph-based Recommender system, named TTA-GREC, to dynamically adapt user-item graphs at test time in a data-centric way, handling distribution shifts effectively. Specifically, our TTA-GREC targets KG-enhanced GNN-based recommender systems with three core components: (1) Pseudo-label guided UI graph transformation for adaptive improvement; (2) Rationale score guided KG graph revision for semantic enhancement; and (3) Sampling-based self-supervised adaptation for contrastive learning. Experiments demonstrate TTA-GREC's superiority at test time and provide new data-centric insights on test-time adaptation for better recommender system inference.
Cite
Text
Liu et al. "LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/510Markdown
[Liu et al. "LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/liu2024ijcai-longvq/) doi:10.24963/ijcai.2024/510BibTeX
@inproceedings{liu2024ijcai-longvq,
title = {{LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory}},
author = {Liu, Zicheng and Wang, Li and Li, Siyuan and Wang, Zedong and Lin, Haitao and Li, Stan Z.},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2024},
pages = {4614-4622},
doi = {10.24963/ijcai.2024/510},
url = {https://mlanthology.org/ijcai/2024/liu2024ijcai-longvq/}
}