AIC and BIC Based Approaches for SVM Parameter Value Estimation with RBF Kernels

Abstract

We study the problem of selecting the best parameter values to use for a support vector machine (SVM) with RBF kernel. Our methods extend the well-known formulas for AIC and BIC, and we present two alternative approaches for calculating the necessary likelihood functions for these formulas. Our first approach is based on using the distances of support vectors from the separating hyperplane. Our second approach estimates the probability that the SVM hyperplane coincides with the Bayes classifier, by analysing the disposition of points in the kernel feature space. We experimentally compare our two approaches with several existing methods and show they are able to achieve good accuracy, whilst also having low running time.

Cite

Text

Demyanov et al. "AIC and BIC Based Approaches for SVM Parameter Value Estimation with RBF Kernels." Proceedings of the Fourth Asian Conference on Machine Learning, 2012.

Markdown

[Demyanov et al. "AIC and BIC Based Approaches for SVM Parameter Value Estimation with RBF Kernels." Proceedings of the Fourth Asian Conference on Machine Learning, 2012.](https://mlanthology.org/acml/2012/demyanov2012acml-aic/)

BibTeX

@inproceedings{demyanov2012acml-aic,
  title     = {{AIC and BIC Based Approaches for SVM Parameter Value Estimation with RBF Kernels}},
  author    = {Demyanov, Sergey and Bailey, James and Ramamohanarao, Kotagiri and Leckie, Christopher},
  booktitle = {Proceedings of the Fourth Asian Conference on Machine Learning},
  year      = {2012},
  pages     = {97-112},
  volume    = {25},
  url       = {https://mlanthology.org/acml/2012/demyanov2012acml-aic/}
}