Robust Principal Component Analysis by Reverse Iterative Linear Programming

Abstract

Principal Components Analysis (PCA) is a data analysis technique widely used in dimensionality reduction. It extracts a small number of orthonormal vectors that explain most of the variation in a dataset, which are called the Principal Components. Conventional PCA is sensitive to outliers because it is based on the $L_2$ -norm, so to improve robustness several algorithms based on the $L_1$ -norm have been introduced in the literature. We present a new algorithm for robust $L_1$ -norm PCA that computes components iteratively in reverse, using a new heuristic based on Linear Programming. This solution is focused on finding the projection that minimizes the variance of the projected points. It has only one parameter to tune, making it simple to use. On common benchmarks it performs competitively compared to other methods. The data and software related to this paper are available at https://github.com/visentin-insight/L1-PCAhp .

Cite

Text

Visentin et al. "Robust Principal Component Analysis by Reverse Iterative Linear Programming." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2016. doi:10.1007/978-3-319-46227-1_37

Markdown

[Visentin et al. "Robust Principal Component Analysis by Reverse Iterative Linear Programming." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2016.](https://mlanthology.org/ecmlpkdd/2016/visentin2016ecmlpkdd-robust/) doi:10.1007/978-3-319-46227-1_37

BibTeX

@inproceedings{visentin2016ecmlpkdd-robust,
  title     = {{Robust Principal Component Analysis by Reverse Iterative Linear Programming}},
  author    = {Visentin, Andrea and Prestwich, Steven D. and Tarim, S. Armagan},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2016},
  pages     = {593-605},
  doi       = {10.1007/978-3-319-46227-1_37},
  url       = {https://mlanthology.org/ecmlpkdd/2016/visentin2016ecmlpkdd-robust/}
}