Online Knowledge-Based Support Vector Machines
Abstract
Prior knowledge, in the form of simple advice rules, can greatly speed up convergence in learning algorithms. Online learning methods predict the label of the current point and then receive the correct label (and learn from that information). The goal of this work is to update the hypothesis taking into account not just the label feedback, but also the prior knowledge, in the form of soft polyhedral advice, so as to make increasingly accurate predictions on subsequent examples. Advice helps speed up and bias learning so that generalization can be obtained with less data. Our passive-aggressive approach updates the hypothesis using a hybrid loss that takes into account the margins of both the hypothesis and the advice on the current point. Encouraging computational results and loss bounds are provided.
Cite
Text
Kunapuli et al. "Online Knowledge-Based Support Vector Machines." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2010. doi:10.1007/978-3-642-15883-4_10Markdown
[Kunapuli et al. "Online Knowledge-Based Support Vector Machines." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2010.](https://mlanthology.org/ecmlpkdd/2010/kunapuli2010ecmlpkdd-online/) doi:10.1007/978-3-642-15883-4_10BibTeX
@inproceedings{kunapuli2010ecmlpkdd-online,
title = {{Online Knowledge-Based Support Vector Machines}},
author = {Kunapuli, Gautam and Bennett, Kristin P. and Shabbeer, Amina and Maclin, Richard and Shavlik, Jude W.},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2010},
pages = {145-161},
doi = {10.1007/978-3-642-15883-4_10},
url = {https://mlanthology.org/ecmlpkdd/2010/kunapuli2010ecmlpkdd-online/}
}