Ridge Regression, Hubness, and Zero-Shot Learning
Abstract
This paper discusses the effect of hubness in zero-shot learning, when ridge regression is used to find a mapping between the example space to the label space. Contrary to the existing approach, which attempts to find a mapping from the example space to the label space, we show that mapping labels into the example space is desirable to suppress the emergence of hubs in the subsequent nearest neighbor search step. Assuming a simple data model, we prove that the proposed approach indeed reduces hubness. This was verified empirically on the tasks of bilingual lexicon extraction and image labeling: hubness was reduced with both of these tasks and the accuracy was improved accordingly.
Cite
Text
Shigeto et al. "Ridge Regression, Hubness, and Zero-Shot Learning." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015. doi:10.1007/978-3-319-23528-8_9Markdown
[Shigeto et al. "Ridge Regression, Hubness, and Zero-Shot Learning." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015.](https://mlanthology.org/ecmlpkdd/2015/shigeto2015ecmlpkdd-ridge/) doi:10.1007/978-3-319-23528-8_9BibTeX
@inproceedings{shigeto2015ecmlpkdd-ridge,
title = {{Ridge Regression, Hubness, and Zero-Shot Learning}},
author = {Shigeto, Yutaro and Suzuki, Ikumi and Hara, Kazuo and Shimbo, Masashi and Matsumoto, Yuji},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2015},
pages = {135-151},
doi = {10.1007/978-3-319-23528-8_9},
url = {https://mlanthology.org/ecmlpkdd/2015/shigeto2015ecmlpkdd-ridge/}
}