Multiplicative Updates for Large Margin Classifiers

Abstract

Various problems in nonnegative quadratic programming arise in the training of large margin classifiers. We derive multiplicative updates for these problems that converge monotonically to the desired solutions for hard and soft margin classifiers. The updates differ strikingly in form from other multiplicative updates used in machine learning. In this paper, we provide complete proofs of convergence for these updates and extend previous work to incorporate sum and box constraints in addition to nonnegativity.

Cite

Text

Sha et al. "Multiplicative Updates for Large Margin Classifiers." Annual Conference on Computational Learning Theory, 2003. doi:10.1007/978-3-540-45167-9_15

Markdown

[Sha et al. "Multiplicative Updates for Large Margin Classifiers." Annual Conference on Computational Learning Theory, 2003.](https://mlanthology.org/colt/2003/sha2003colt-multiplicative/) doi:10.1007/978-3-540-45167-9_15

BibTeX

@inproceedings{sha2003colt-multiplicative,
  title     = {{Multiplicative Updates for Large Margin Classifiers}},
  author    = {Sha, Fei and Saul, Lawrence K. and Lee, Daniel D.},
  booktitle = {Annual Conference on Computational Learning Theory},
  year      = {2003},
  pages     = {188-202},
  doi       = {10.1007/978-3-540-45167-9_15},
  url       = {https://mlanthology.org/colt/2003/sha2003colt-multiplicative/}
}