Is Combining Classifiers Better than Selecting the Best One

Abstract

We empirically evaluate several state-of-the-art methods for constructing ensembles of heterogeneous classifiers with stacking and show that they perform (at best) comparably to selecting the best classifier from the ensemble by cross validation. We then propose a new method for stacking, that uses multi-response model trees at the meta-level, and show that it clearly outperforms existing stacking approaches and selecting the best classifier by cross validation.

Cite

Text

Dzeroski and Zenko. "Is Combining Classifiers Better than Selecting the Best One." International Conference on Machine Learning, 2002.

Markdown

[Dzeroski and Zenko. "Is Combining Classifiers Better than Selecting the Best One." International Conference on Machine Learning, 2002.](https://mlanthology.org/icml/2002/dzeroski2002icml-combining/)

BibTeX

@inproceedings{dzeroski2002icml-combining,
  title     = {{Is Combining Classifiers Better than Selecting the Best One}},
  author    = {Dzeroski, Saso and Zenko, Bernard},
  booktitle = {International Conference on Machine Learning},
  year      = {2002},
  pages     = {123-130},
  url       = {https://mlanthology.org/icml/2002/dzeroski2002icml-combining/}
}