A Unified Framework for Evaluation Metrics in Classification Using Decision Trees
Abstract
Most evaluation metrics in classification are designed to reward class uniformity in the example subsets induced by a feature (e.g., Information Gain). Other metrics are designed to reward discrimination power in the context of feature selection as a means to combat the feature-interaction problem (e.g., Relief, Contextual Merit). We define a new framework that combines the strengths of both kinds of metrics. Our framework enriches the available information when considering which feature to use to partition the training set. Since most metrics rely on only a small fraction of this information, this framework enlarges the space of possible metrics. Experiments on real-world domains in the context of decision-tree learning show how a simple setting for our framework compares well with standard metrics.
Cite
Text
Vilalta et al. "A Unified Framework for Evaluation Metrics in Classification Using Decision Trees." European Conference on Machine Learning, 2001. doi:10.1007/3-540-44795-4_43Markdown
[Vilalta et al. "A Unified Framework for Evaluation Metrics in Classification Using Decision Trees." European Conference on Machine Learning, 2001.](https://mlanthology.org/ecmlpkdd/2001/vilalta2001ecml-unified/) doi:10.1007/3-540-44795-4_43BibTeX
@inproceedings{vilalta2001ecml-unified,
title = {{A Unified Framework for Evaluation Metrics in Classification Using Decision Trees}},
author = {Vilalta, Ricardo and Brodie, Mark and Oblinger, Daniel and Rish, Irina},
booktitle = {European Conference on Machine Learning},
year = {2001},
pages = {503-514},
doi = {10.1007/3-540-44795-4_43},
url = {https://mlanthology.org/ecmlpkdd/2001/vilalta2001ecml-unified/}
}