An Ensemble Uncertainty Aware Measure for Directed Hill Climbing Ensemble Pruning
Abstract
This paper proposes a new measure for ensemble pruning via directed hill climbing, dubbed Uncertainty Weighted Accuracy (UWA), which takes into account the uncertainty of the decision of the current ensemble. Empirical results on 30 data sets show that using the proposed measure to prune a heterogeneous ensemble leads to significantly better accuracy results compared to state-of-the-art measures and other baseline methods, while keeping only a small fraction of the original models. Besides the evaluation measure, the paper also studies two other parameters of directed hill climbing ensemble pruning methods, the search direction and the evaluation dataset, with interesting conclusions on appropriate values.
Cite
Text
Partalas et al. "An Ensemble Uncertainty Aware Measure for Directed Hill Climbing Ensemble Pruning." Machine Learning, 2010. doi:10.1007/S10994-010-5172-0Markdown
[Partalas et al. "An Ensemble Uncertainty Aware Measure for Directed Hill Climbing Ensemble Pruning." Machine Learning, 2010.](https://mlanthology.org/mlj/2010/partalas2010mlj-ensemble/) doi:10.1007/S10994-010-5172-0BibTeX
@article{partalas2010mlj-ensemble,
title = {{An Ensemble Uncertainty Aware Measure for Directed Hill Climbing Ensemble Pruning}},
author = {Partalas, Ioannis and Tsoumakas, Grigorios and Vlahavas, Ioannis P.},
journal = {Machine Learning},
year = {2010},
pages = {257-282},
doi = {10.1007/S10994-010-5172-0},
volume = {81},
url = {https://mlanthology.org/mlj/2010/partalas2010mlj-ensemble/}
}