Confidence-Weighted Linear Classification
Abstract
We introduce confidence-weighted linear classifiers, a new class of algorithms that maintain confidence information about classifier parameters. Learning in this framework updates parameters by estimating weights and increasing model confidence. We investigate a new online algorithm that maintains a Gaussian distribution over weight vectors, updating the mean and variance of the model with each instance. Empirical evaluation on a range of NLP tasks show that our algorithm improves over other state of the art online and batch methods, learns faster in the online setting, and lends itself to better classifier combination after parallel training.
Cite
Text
Dredze et al. "Confidence-Weighted Linear Classification." International Conference on Machine Learning, 2008. doi:10.1145/1390156.1390190Markdown
[Dredze et al. "Confidence-Weighted Linear Classification." International Conference on Machine Learning, 2008.](https://mlanthology.org/icml/2008/dredze2008icml-confidence/) doi:10.1145/1390156.1390190BibTeX
@inproceedings{dredze2008icml-confidence,
title = {{Confidence-Weighted Linear Classification}},
author = {Dredze, Mark and Crammer, Koby and Pereira, Fernando},
booktitle = {International Conference on Machine Learning},
year = {2008},
pages = {264-271},
doi = {10.1145/1390156.1390190},
url = {https://mlanthology.org/icml/2008/dredze2008icml-confidence/}
}