Domain Adaptation via Maximizing Surrogate Mutual Information
Abstract
Unsupervised domain adaptation (UDA), which is an important topic in transfer learning, aims to predict unlabeled data from target domain with access to labeled data from the source domain. In this work, we propose a novel framework called SIDA (Surrogate Mutual Information Maximization Domain Adaptation) with strong theoretical guarantees. To be specific, SIDA implements adaptation by maximizing mutual information (MI) between features. In the framework, a surrogate joint distribution models the underlying joint distribution of the unlabeled target domain. Our theoretical analysis validates SIDA by bounding the expected risk on target domain with MI and surrogate distribution bias. Experiments show that our approach is comparable with state-of-the-art unsupervised adaptation methods on standard UDA tasks.
Cite
Text
Zhao et al. "Domain Adaptation via Maximizing Surrogate Mutual Information." International Joint Conference on Artificial Intelligence, 2022. doi:10.24963/IJCAI.2022/237Markdown
[Zhao et al. "Domain Adaptation via Maximizing Surrogate Mutual Information." International Joint Conference on Artificial Intelligence, 2022.](https://mlanthology.org/ijcai/2022/zhao2022ijcai-domain/) doi:10.24963/IJCAI.2022/237BibTeX
@inproceedings{zhao2022ijcai-domain,
title = {{Domain Adaptation via Maximizing Surrogate Mutual Information}},
author = {Zhao, Haiteng and Ma, Chang and Chen, Qinyu and Deng, Zhi-Hong},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2022},
pages = {1700-1706},
doi = {10.24963/IJCAI.2022/237},
url = {https://mlanthology.org/ijcai/2022/zhao2022ijcai-domain/}
}