Spin Discriminant Analysis (SDA) - Using a One-Dimensional Classifier for High Dimensional Classification Problems
Abstract
In this paper we discuss how to use a one-dimensional classifier for solving high dimensional classification problems. We propose Spin Discriminant Analysis (SDA), which enables us to construct a family of new classifiers. We prove that SDA is equivalent to ridged Linear Discriminant Analysis (LDA) when two classes are Gaussians with common covariance matrices. Moreover, we prove that classification based on Parzen's window, is a special case of SDA. In addition to theoretical investigations, we conduct extensive empirical studies, implementing SDA using Support Vector Machines (SVMs) as its one-dimensional classifiers. This SVM-based SDA implementation is named SpinSVM. Our experiments show that SpinSVM outperforms traditional high dimensional classifiers like SVMs, Classification Using Spline (CUS), classification-based Parzen's window, and LDA on most standard and synthetic datasets we tested.
Cite
Text
You et al. "Spin Discriminant Analysis (SDA) - Using a One-Dimensional Classifier for High Dimensional Classification Problems." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001. doi:10.1109/CVPR.2001.990635Markdown
[You et al. "Spin Discriminant Analysis (SDA) - Using a One-Dimensional Classifier for High Dimensional Classification Problems." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001.](https://mlanthology.org/cvpr/2001/you2001cvpr-spin/) doi:10.1109/CVPR.2001.990635BibTeX
@inproceedings{you2001cvpr-spin,
title = {{Spin Discriminant Analysis (SDA) - Using a One-Dimensional Classifier for High Dimensional Classification Problems}},
author = {You, Huaxin and Hua, Hong and Ahuja, Narendra and Chang, Edward Y.},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2001},
pages = {I:968-975},
doi = {10.1109/CVPR.2001.990635},
url = {https://mlanthology.org/cvpr/2001/you2001cvpr-spin/}
}