Duality, Geometry, and Support Vector Regression
Abstract
We develop an intuitive geometric framework for support vector regression (SVR). By examining when (cid:15)-tubes exist, we show that SVR can be regarded as a classi(cid:12)cation problem in the dual space. Hard and soft (cid:15)-tubes are constructed by separating the convex or reduced convex hulls respectively of the training data with the response variable shifted up and down by (cid:15). A novel SVR model is proposed based on choosing the max-margin plane between the two shifted datasets. Maximizing the margin corresponds to shrinking the e(cid:11)ective (cid:15)-tube. In the proposed approach the e(cid:11)ects of the choices of all parameters become clear geometrically.
Cite
Text
Bi and Bennett. "Duality, Geometry, and Support Vector Regression." Neural Information Processing Systems, 2001.Markdown
[Bi and Bennett. "Duality, Geometry, and Support Vector Regression." Neural Information Processing Systems, 2001.](https://mlanthology.org/neurips/2001/bi2001neurips-duality/)BibTeX
@inproceedings{bi2001neurips-duality,
title = {{Duality, Geometry, and Support Vector Regression}},
author = {Bi, J. and Bennett, Kristin P.},
booktitle = {Neural Information Processing Systems},
year = {2001},
pages = {593-600},
url = {https://mlanthology.org/neurips/2001/bi2001neurips-duality/}
}