A Projection-Based Framework for Classifier Performance Evaluation
Abstract
In this paper, we propose approaching the problem of classifier evaluation in terms of a projection from a high-dimensional space to a visualizable two-dimensional one. Rather than collapsing confusion matrices into a single measure the way traditional evaluation methods do, we consider the vector composed of the entries of the confusion matrix (or the confusion matrices in case several domains are considered simultaneously) as the performance evaluation vector, and project it into a two dimensional space using a recently proposed distance-preserving projection method. This approach is shown to be particularly useful in the case of comparison of several classifiers on many domains as well as in the case of multiclass classification. Furthermore, by providing simultaneous multiple views of the same evaluation data, it allows for a quick and accurate assessment of classifier performance.
Cite
Text
Japkowicz et al. "A Projection-Based Framework for Classifier Performance Evaluation." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2008. doi:10.1007/978-3-540-87479-9_54Markdown
[Japkowicz et al. "A Projection-Based Framework for Classifier Performance Evaluation." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2008.](https://mlanthology.org/ecmlpkdd/2008/japkowicz2008ecmlpkdd-projectionbased/) doi:10.1007/978-3-540-87479-9_54BibTeX
@inproceedings{japkowicz2008ecmlpkdd-projectionbased,
title = {{A Projection-Based Framework for Classifier Performance Evaluation}},
author = {Japkowicz, Nathalie and Sanghi, Pritika and Tischer, Peter E.},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2008},
pages = {548-563},
doi = {10.1007/978-3-540-87479-9_54},
url = {https://mlanthology.org/ecmlpkdd/2008/japkowicz2008ecmlpkdd-projectionbased/}
}