SAH: Shifting-Aware Asymmetric Hashing for Reverse K Maximum Inner Product Search

Abstract

This paper investigates a new yet challenging problem called Reverse k-Maximum Inner Product Search (RkMIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of RkMIPS aims to find a set of user vectors whose inner products with the query vector are one of the k largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the RkMIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4~8x faster than the state-of-the-art methods for RkMIPS while achieving F1-scores of over 90%. The code is available at https://github.com/HuangQiang/SAH.

Cite

Text

Huang et al. "SAH: Shifting-Aware Asymmetric Hashing for Reverse K Maximum Inner Product Search." AAAI Conference on Artificial Intelligence, 2023. doi:10.1609/AAAI.V37I4.25550

Markdown

[Huang et al. "SAH: Shifting-Aware Asymmetric Hashing for Reverse K Maximum Inner Product Search." AAAI Conference on Artificial Intelligence, 2023.](https://mlanthology.org/aaai/2023/huang2023aaai-sah/) doi:10.1609/AAAI.V37I4.25550

BibTeX

@inproceedings{huang2023aaai-sah,
  title     = {{SAH: Shifting-Aware Asymmetric Hashing for Reverse K Maximum Inner Product Search}},
  author    = {Huang, Qiang and Wang, Yanhao and Tung, Anthony K. H.},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2023},
  pages     = {4312-4321},
  doi       = {10.1609/AAAI.V37I4.25550},
  url       = {https://mlanthology.org/aaai/2023/huang2023aaai-sah/}
}