Meta Pseudo Labels

Hieu Pham, Zihang Dai, Qizhe Xie, Quoc V. Le

CVPR 2021 pp. 11557-11568

doi:10.1109/CVPR46437.2021.01139 /cvpr/2021/pham2021cvpr-meta/

Abstract

We present Meta Pseudo Labels, a semi-supervised learning method that achieves a new state-of-the-art top-1 accuracy of 90.2% on ImageNet, which is 1.6% better than the existing state-of-the-art. Like Pseudo Labels, Meta Pseudo Labels has a teacher network to generate pseudo labels on unlabeled data to teach a student network. However, unlike Pseudo Labels where the teacher is kept fixed, in Meta Pseudo Labels, the teacher is constantly adapted by the feedback of how well the student performs on the labeled dataset. As a result, the teacher generates better pseudo labels to teach the student.

PDF CVPR Semantic Scholar

Cite

Text

Pham et al. "Meta Pseudo Labels." Conference on Computer Vision and Pattern Recognition, 2021. doi:10.1109/CVPR46437.2021.01139

Markdown

[Pham et al. "Meta Pseudo Labels." Conference on Computer Vision and Pattern Recognition, 2021.](https://mlanthology.org/cvpr/2021/pham2021cvpr-meta/) doi:10.1109/CVPR46437.2021.01139

BibTeX

@inproceedings{pham2021cvpr-meta,
  title     = {{Meta Pseudo Labels}},
  author    = {Pham, Hieu and Dai, Zihang and Xie, Qizhe and Le, Quoc V.},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2021},
  pages     = {11557-11568},
  doi       = {10.1109/CVPR46437.2021.01139},
  url       = {https://mlanthology.org/cvpr/2021/pham2021cvpr-meta/}
}