A Unified Approach to Active Dual Supervision for Labeling Features and Examples
Abstract
When faced with the task of building accurate classifiers, active learning is often a beneficial tool for minimizing the requisite costs of human annotation. Traditional active learning schemes query a human for labels on intelligently chosen examples. However, human effort can also be expended in collecting alternative forms of annotation. For example, one may attempt to learn a text classifier by labeling words associated with a class, instead of, or in addition to, documents. Learning from two different kinds of supervision adds a challenging dimension to the problem of active learning. In this paper, we present a unified approach to such active dual supervision: determining which feature or example a classifier is most likely to benefit from having labeled. Empirical results confirm that appropriately querying for both example and feature labels significantly reduces overall human effort—beyond what is possible through traditional one-dimensional active learning.
Cite
Text
Attenberg et al. "A Unified Approach to Active Dual Supervision for Labeling Features and Examples." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2010. doi:10.1007/978-3-642-15880-3_9Markdown
[Attenberg et al. "A Unified Approach to Active Dual Supervision for Labeling Features and Examples." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2010.](https://mlanthology.org/ecmlpkdd/2010/attenberg2010ecmlpkdd-unified/) doi:10.1007/978-3-642-15880-3_9BibTeX
@inproceedings{attenberg2010ecmlpkdd-unified,
title = {{A Unified Approach to Active Dual Supervision for Labeling Features and Examples}},
author = {Attenberg, Josh and Melville, Prem and Provost, Foster J.},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2010},
pages = {40-55},
doi = {10.1007/978-3-642-15880-3_9},
url = {https://mlanthology.org/ecmlpkdd/2010/attenberg2010ecmlpkdd-unified/}
}