A Training Algorithm for Optimal Margin Classifiers

Abstract

A training algorithm that maximizes the margin between the training patterns and the decision boundary is presented. The technique is applicable to a wide variety of the classification functions, including Perceptrons, polynomials, and Radial Basis Functions. The effective number of parameters is adjusted automatically to match the complexity of the problem. The solution is expressed as a linear combination of supporting patterns. These are the subset of training patterns that are closest to the decision boundary. Bounds on the generalization performance based on the leave-one-out method and the VC-dimension are given. Experimental results on optical character recognition problems demonstrate the good generalization obtained when compared with other learning algorithms.

Cite

Text

Boser et al. "A Training Algorithm for Optimal Margin Classifiers." Annual Conference on Computational Learning Theory, 1992. doi:10.1145/130385.130401

Markdown

[Boser et al. "A Training Algorithm for Optimal Margin Classifiers." Annual Conference on Computational Learning Theory, 1992.](https://mlanthology.org/colt/1992/boser1992colt-training/) doi:10.1145/130385.130401

BibTeX

@inproceedings{boser1992colt-training,
  title     = {{A Training Algorithm for Optimal Margin Classifiers}},
  author    = {Boser, Bernhard E. and Guyon, Isabelle and Vapnik, Vladimir},
  booktitle = {Annual Conference on Computational Learning Theory},
  year      = {1992},
  pages     = {144-152},
  doi       = {10.1145/130385.130401},
  url       = {https://mlanthology.org/colt/1992/boser1992colt-training/}
}