Rank/Norm Regularization with Closed-Form Solutions: Application to Subspace Clustering
Abstract
When data is sampled from an unknown subspace, principal component analysis (PCA) provides an effective way to estimate the subspace and hence reduce the dimension of the data. At the heart of PCA is the Eckart-Young-Mirsky theorem, which characterizes the best rank k approximation of a matrix. In this paper, we prove a generalization of the Eckart-Young-Mirsky theorem under all unitarily invariant norms. Using this result, we obtain closed-form solutions for a set of rank/norm regularized problems, and derive closed-form solutions for a general class of subspace clustering problems (where data is modelled by unions of unknown subspaces). From these results we obtain new theoretical insights and promising experimental results.
Cite
Text
Yu and Schuurmans. "Rank/Norm Regularization with Closed-Form Solutions: Application to Subspace Clustering." Conference on Uncertainty in Artificial Intelligence, 2011.Markdown
[Yu and Schuurmans. "Rank/Norm Regularization with Closed-Form Solutions: Application to Subspace Clustering." Conference on Uncertainty in Artificial Intelligence, 2011.](https://mlanthology.org/uai/2011/yu2011uai-rank/)BibTeX
@inproceedings{yu2011uai-rank,
title = {{Rank/Norm Regularization with Closed-Form Solutions: Application to Subspace Clustering}},
author = {Yu, Yaoliang and Schuurmans, Dale},
booktitle = {Conference on Uncertainty in Artificial Intelligence},
year = {2011},
pages = {778-785},
url = {https://mlanthology.org/uai/2011/yu2011uai-rank/}
}