Diversity Regularized Ensemble Pruning
Abstract
Diversity among individual classifiers is recognized to play a key role in ensemble, however, few theoretical properties are known for classification. In this paper, by focusing on the popular ensemble pruning setting (i.e., combining classifier by voting and measuring diversity in pairwise manner), we present a theoretical study on the effect of diversity on the generalization performance of voting in the PAC-learning framework. It is disclosed that the diversity is closely-related to the hypothesis space complexity, and encouraging diversity can be regarded to apply regularization on ensemble methods. Guided by this analysis, we apply explicit diversity regularization to ensemble pruning, and propose the Diversity Regularized Ensemble Pruning (DREP) method. Experimental results show the effectiveness of DREP.
Cite
Text
Li et al. "Diversity Regularized Ensemble Pruning." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2012. doi:10.1007/978-3-642-33460-3_27Markdown
[Li et al. "Diversity Regularized Ensemble Pruning." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2012.](https://mlanthology.org/ecmlpkdd/2012/li2012ecmlpkdd-diversity/) doi:10.1007/978-3-642-33460-3_27BibTeX
@inproceedings{li2012ecmlpkdd-diversity,
title = {{Diversity Regularized Ensemble Pruning}},
author = {Li, Nan and Yu, Yang and Zhou, Zhi-Hua},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2012},
pages = {330-345},
doi = {10.1007/978-3-642-33460-3_27},
url = {https://mlanthology.org/ecmlpkdd/2012/li2012ecmlpkdd-diversity/}
}