Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery
Abstract
Nonconvex matrix recovery is known to contain no spurious local minima under a restricted isometry property (RIP) with a sufficiently small RIP constant $\delta$. If $\delta$ is too large, however, then counterexamples containing spurious local minima are known to exist. In this paper, we introduce a proof technique that is capable of establishing sharp thresholds on $\delta$ to guarantee the inexistence of spurious local minima. Using the technique, we prove that in the case of a rank-1 ground truth, an RIP constant of $\delta<1/2$ is both necessary and sufficient for exact recovery from any arbitrary initial point (such as a random point). We also prove a local recovery result: given an initial point $x_{0}$ satisfying $f(x_{0})\le(1-\delta)^{2}f(0)$, any descent algorithm that converges to second-order optimality guarantees exact recovery.
Cite
Text
Zhang et al. "Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery." Journal of Machine Learning Research, 2019.Markdown
[Zhang et al. "Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery." Journal of Machine Learning Research, 2019.](https://mlanthology.org/jmlr/2019/zhang2019jmlr-sharp/)BibTeX
@article{zhang2019jmlr-sharp,
title = {{Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery}},
author = {Zhang, Richard Y. and Sojoudi, Somayeh and Lavaei, Javad},
journal = {Journal of Machine Learning Research},
year = {2019},
pages = {1-34},
volume = {20},
url = {https://mlanthology.org/jmlr/2019/zhang2019jmlr-sharp/}
}