Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers
Abstract
We study the leave-one-out and generalization errors of voting combinations of learning machines. A special case considered is a variant of bagging. We analyze in detail combinations of kernel machines, such as support vector machines, and present theoretical estimates of their leave-one-out error. We also derive novel bounds on the stability of combinations of any classifiers. These bounds can be used to formally show that, for example, bagging increases the stability of unstable learning machines. We report experiments supporting the theoretical findings.
Cite
Text
Evgeniou et al. "Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers." Machine Learning, 2004. doi:10.1023/B:MACH.0000019805.88351.60Markdown
[Evgeniou et al. "Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers." Machine Learning, 2004.](https://mlanthology.org/mlj/2004/evgeniou2004mlj-leave/) doi:10.1023/B:MACH.0000019805.88351.60BibTeX
@article{evgeniou2004mlj-leave,
title = {{Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers}},
author = {Evgeniou, Theodoros and Pontil, Massimiliano and Elisseeff, André},
journal = {Machine Learning},
year = {2004},
pages = {71-97},
doi = {10.1023/B:MACH.0000019805.88351.60},
volume = {55},
url = {https://mlanthology.org/mlj/2004/evgeniou2004mlj-leave/}
}