Rademacher Penalization over Decision Tree Prunings
Abstract
Rademacher penalization is a modern technique for obtaining data-dependent bounds on the generalization error of classifiers. It would appear to be limited to relatively simple hypothesis classes because of computational complexity issues. In this paper we, nevertheless, apply Rademacher penalization to the in practice important hypothesis class of unrestricted decision trees by considering the prunings of a given decision tree rather than the tree growing phase. Moreover, we generalize the error-bounding approach from binary classification to multi-class situations. Our empirical experiments indicate that the proposed new bounds clearly outperform earlier bounds for decision tree prunings and provide non-trivial error estimates on real-world data sets.
Cite
Text
Kääriäinen and Elomaa. "Rademacher Penalization over Decision Tree Prunings." European Conference on Machine Learning, 2003. doi:10.1007/978-3-540-39857-8_19Markdown
[Kääriäinen and Elomaa. "Rademacher Penalization over Decision Tree Prunings." European Conference on Machine Learning, 2003.](https://mlanthology.org/ecmlpkdd/2003/kaariainen2003ecml-rademacher/) doi:10.1007/978-3-540-39857-8_19BibTeX
@inproceedings{kaariainen2003ecml-rademacher,
title = {{Rademacher Penalization over Decision Tree Prunings}},
author = {Kääriäinen, Matti and Elomaa, Tapio},
booktitle = {European Conference on Machine Learning},
year = {2003},
pages = {193-204},
doi = {10.1007/978-3-540-39857-8_19},
url = {https://mlanthology.org/ecmlpkdd/2003/kaariainen2003ecml-rademacher/}
}