ML Anthology

The Bitvector Machine: A Fast and Robust Machine Learning Algorithm for Non-Linear Problems

Stefan Edelkamp, Martin Stommel
ECML-PKDD 2012 pp. 175-190
doi:10.1007/978-3-642-33460-3_17 /ecmlpkdd/2012/edelkamp2012ecmlpkdd-bitvector/

Abstract

In this paper we present and evaluate a simple but effective machine learning algorithm that we call Bitvector Machine : Feature vectors are partitioned along component-wise quantiles and converted into bitvectors that are learned. It is shown that the method is efficient in both training and classification. The effectiveness of the method is analysed theoretically for best and worst-case scenarios. Experiments on high-dimensional synthetic and real world data show a huge speed boost compared to Support Vector Machines with RBF kernel. By tabulating kernel functions, computing medians in linear-time, and exploiting modern processor technology for advanced bitvector operations, we achieve a speed-up of 32 for classification and 48 for kernel evaluation compared to the popular LIBSVM. Although the method does not generally outperform a SVM with RBF kernel it achieves a high classification accuracy and has qualitative advantages over the linear classifier.

PDF ECML-PKDD Semantic Scholar

Cite

Text

Edelkamp and Stommel. "The Bitvector Machine: A Fast and Robust Machine Learning Algorithm for Non-Linear Problems." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2012. doi:10.1007/978-3-642-33460-3_17

Markdown

[Edelkamp and Stommel. "The Bitvector Machine: A Fast and Robust Machine Learning Algorithm for Non-Linear Problems." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2012.](https://mlanthology.org/ecmlpkdd/2012/edelkamp2012ecmlpkdd-bitvector/) doi:10.1007/978-3-642-33460-3_17

BibTeX

@inproceedings{edelkamp2012ecmlpkdd-bitvector,
  title     = {{The Bitvector Machine: A Fast and Robust Machine Learning Algorithm for Non-Linear Problems}},
  author    = {Edelkamp, Stefan and Stommel, Martin},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2012},
  pages     = {175-190},
  doi       = {10.1007/978-3-642-33460-3_17},
  url       = {https://mlanthology.org/ecmlpkdd/2012/edelkamp2012ecmlpkdd-bitvector/}
}