Optimal Reduced-Set Vectors for Support Vector Machines with a Quadratic Kernel

Abstract

To reduce computational cost, the discriminant function of a support vector machine (SVM) should be represented using as few vectors as possible. This problem has been tackled in different ways. In this article, we develop an explicit solution in the case of a general quadratic kernel k(x, x′) = (C + Dx⊺x′)2. For a given number of vectors, this solution provides the best possible approximation and can even recover the discriminant function if the number of used vectors is large enough. The key idea is to express the inhomogeneous kernel as a homogeneous kernel on a space having one dimension more than the original one and to follow the approach of Burges (1996).

Cite

Text

Thies and Weber. "Optimal Reduced-Set Vectors for Support Vector Machines with a Quadratic Kernel." Neural Computation, 2004. doi:10.1162/0899766041336459

Markdown

[Thies and Weber. "Optimal Reduced-Set Vectors for Support Vector Machines with a Quadratic Kernel." Neural Computation, 2004.](https://mlanthology.org/neco/2004/thies2004neco-optimal/) doi:10.1162/0899766041336459

BibTeX

@article{thies2004neco-optimal,
  title     = {{Optimal Reduced-Set Vectors for Support Vector Machines with a Quadratic Kernel}},
  author    = {Thies, Thorsten and Weber, Frank},
  journal   = {Neural Computation},
  year      = {2004},
  pages     = {1769-1777},
  doi       = {10.1162/0899766041336459},
  volume    = {16},
  url       = {https://mlanthology.org/neco/2004/thies2004neco-optimal/}
}