Learning Non-Linear Combinations of Kernels
Abstract
This paper studies the general problem of learning kernels based on a polynomial combination of base kernels. It analyzes this problem in the case of regression and the kernel ridge regression algorithm. It examines the corresponding learning kernel optimization problem, shows how that minimax problem can be reduced to a simpler minimization problem, and proves that the global solution of this problem always lies on the boundary. We give a projection-based gradient descent algorithm for solving the optimization problem, shown empirically to converge in few iterations. Finally, we report the results of extensive experiments with this algorithm using several publicly available datasets demonstrating the effectiveness of our technique.
Cite
Text
Cortes et al. "Learning Non-Linear Combinations of Kernels." Neural Information Processing Systems, 2009.Markdown
[Cortes et al. "Learning Non-Linear Combinations of Kernels." Neural Information Processing Systems, 2009.](https://mlanthology.org/neurips/2009/cortes2009neurips-learning/)BibTeX
@inproceedings{cortes2009neurips-learning,
title = {{Learning Non-Linear Combinations of Kernels}},
author = {Cortes, Corinna and Mohri, Mehryar and Rostamizadeh, Afshin},
booktitle = {Neural Information Processing Systems},
year = {2009},
pages = {396-404},
url = {https://mlanthology.org/neurips/2009/cortes2009neurips-learning/}
}