Data-Dependent Bounds for Multi-Category Classification Based on Convex Losses
Abstract
Algorithms for solving multi-category classification problems using output coding have become very popular in recent years. Following initial attempts with discrete coding matrices, recent work has attempted to alleviate some of their shortcomings by considering real-valued ‘coding’ matrices. We consider an approach to multi-category classification, based on minimizing a convex upper bound on the 0-1 loss. We show that this approach is closely related to output coding, and derive data-dependent bounds on the performance. These bounds can be optimized in order to obtain effective coding matrices, which guarantee small generalization error. Moreover, our results apply directly to kernel based approaches.
Cite
Text
Desyatnikov and Meir. "Data-Dependent Bounds for Multi-Category Classification Based on Convex Losses." Annual Conference on Computational Learning Theory, 2003. doi:10.1007/978-3-540-45167-9_13Markdown
[Desyatnikov and Meir. "Data-Dependent Bounds for Multi-Category Classification Based on Convex Losses." Annual Conference on Computational Learning Theory, 2003.](https://mlanthology.org/colt/2003/desyatnikov2003colt-data/) doi:10.1007/978-3-540-45167-9_13BibTeX
@inproceedings{desyatnikov2003colt-data,
title = {{Data-Dependent Bounds for Multi-Category Classification Based on Convex Losses}},
author = {Desyatnikov, Ilya and Meir, Ron},
booktitle = {Annual Conference on Computational Learning Theory},
year = {2003},
pages = {159-172},
doi = {10.1007/978-3-540-45167-9_13},
url = {https://mlanthology.org/colt/2003/desyatnikov2003colt-data/}
}