Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles
Abstract
Auto-annotation by an ensemble of models is an efficient method of learning on unlabeled data. However, wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. We propose filtering the auto-labeled data using a trained model that predicts the quality of the annotation from the degree of consensus between ensemble models. Using semantic segmentation as an example, we demonstrate the advantage of the proposed auto-annotation filtering over training on data contaminated with inaccurate labels. We show that the performance of a state-of-the-art model can be achieved by training it with only a fraction (30%) of the original manually labeled samples, and replacing the rest with auto-annotated, quality filtered labels.
Cite
Text
Simon et al. "Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020. doi:10.1109/CVPRW50498.2020.00465Markdown
[Simon et al. "Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020.](https://mlanthology.org/cvprw/2020/simon2020cvprw-autoannotation/) doi:10.1109/CVPRW50498.2020.00465BibTeX
@inproceedings{simon2020cvprw-autoannotation,
title = {{Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles}},
author = {Simon, Dror and Farber, Miriam and Goldenberg, Roman},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2020},
pages = {3984-3988},
doi = {10.1109/CVPRW50498.2020.00465},
url = {https://mlanthology.org/cvprw/2020/simon2020cvprw-autoannotation/}
}