On a Connection Between Kernel PCA and Metric Multidimensional Scaling

Abstract

In this note we show that the kernel PCA algorithm of Schölkopf, Smola, and Müller ( Neural Computation, 10 , 1299–1319.) can be interpreted as a form of metric multidimensional scaling (MDS) when the kernel function k ( x , y ) is isotropic, i.e. it depends only on ‖ x − y ‖. This leads to a metric MDS algorithm where the desired configuration of points is found via the solution of an eigenproblem rather than through the iterative optimization of the stress objective function. The question of kernel choice is also discussed.

Cite

Text

Williams. "On a Connection Between Kernel PCA and Metric Multidimensional Scaling." Machine Learning, 2002. doi:10.1023/A:1012485807823

Markdown

[Williams. "On a Connection Between Kernel PCA and Metric Multidimensional Scaling." Machine Learning, 2002.](https://mlanthology.org/mlj/2002/williams2002mlj-connection/) doi:10.1023/A:1012485807823

BibTeX

@article{williams2002mlj-connection,
  title     = {{On a Connection Between Kernel PCA and Metric Multidimensional Scaling}},
  author    = {Williams, Christopher K. I.},
  journal   = {Machine Learning},
  year      = {2002},
  pages     = {11-19},
  doi       = {10.1023/A:1012485807823},
  volume    = {46},
  url       = {https://mlanthology.org/mlj/2002/williams2002mlj-connection/}
}