Ensemble Learning with Supervised Kernels

Abstract

Kernel-based methods have outstanding performance on many machine learning and pattern recognition tasks. However, they are sensitive to kernel selection, they may have low tolerance to noise, and they can not deal with mixed-type or missing data. We propose to derive a novel kernel from an ensemble of decision trees. This leads to kernel methods that naturally handle noisy and heterogeneous data with potentially non-randomly missing values. We demonstrate excellent performance of regularized least square learners based on such kernels.

Cite

Text

Torkkola and Tuv. "Ensemble Learning with Supervised Kernels." European Conference on Machine Learning, 2005. doi:10.1007/11564096_39

Markdown

[Torkkola and Tuv. "Ensemble Learning with Supervised Kernels." European Conference on Machine Learning, 2005.](https://mlanthology.org/ecmlpkdd/2005/torkkola2005ecml-ensemble/) doi:10.1007/11564096_39

BibTeX

@inproceedings{torkkola2005ecml-ensemble,
  title     = {{Ensemble Learning with Supervised Kernels}},
  author    = {Torkkola, Kari and Tuv, Eugene},
  booktitle = {European Conference on Machine Learning},
  year      = {2005},
  pages     = {400-411},
  doi       = {10.1007/11564096_39},
  url       = {https://mlanthology.org/ecmlpkdd/2005/torkkola2005ecml-ensemble/}
}