PLATINUM: Semi-Supervised Model Agnostic Meta-Learning Using Submodular Mutual Information
Abstract
Few-shot classification (FSC) requires training models using a few (typically one to five) data points per class. Meta-learning has proven to be able to learn a parametrized model for FSC by training on various other classification tasks. In this work, we propose PLATINUM (semi-suPervised modeL Agnostic meTa learnIng usiNg sUbmodular Mutual information ), a novel semi-supervised model agnostic meta learning framework that uses the submodular mutual in- formation (SMI) functions to boost the perfor- mance of FSC. PLATINUM leverages unlabeled data in the inner and outer loop using SMI func- tions during meta-training and obtains richer meta- learned parameterizations. We study the per- formance of PLATINUM in two scenarios - 1) where the unlabeled data points belong to the same set of classes as the labeled set of a cer- tain episode, and 2) where there exist out-of- distribution classes that do not belong to the la- beled set. We evaluate our method on various settings on the miniImageNet, tieredImageNet and CIFAR-FS datasets. Our experiments show that PLATINUM outperforms MAML and semi- supervised approaches like pseduo-labeling for semi-supervised FSC, especially for small ratio of labeled to unlabeled samples.
Cite
Text
Li et al. "PLATINUM: Semi-Supervised Model Agnostic Meta-Learning Using Submodular Mutual Information." International Conference on Machine Learning, 2022.Markdown
[Li et al. "PLATINUM: Semi-Supervised Model Agnostic Meta-Learning Using Submodular Mutual Information." International Conference on Machine Learning, 2022.](https://mlanthology.org/icml/2022/li2022icml-platinum/)BibTeX
@inproceedings{li2022icml-platinum,
title = {{PLATINUM: Semi-Supervised Model Agnostic Meta-Learning Using Submodular Mutual Information}},
author = {Li, Changbin and Kothawade, Suraj and Chen, Feng and Iyer, Rishabh},
booktitle = {International Conference on Machine Learning},
year = {2022},
pages = {12826-12842},
volume = {162},
url = {https://mlanthology.org/icml/2022/li2022icml-platinum/}
}