Proximal Iteratively Reweighted Algorithm with Multiple Splitting for Nonconvex Sparsity Optimization
Abstract
This paper proposes the Proximal Iteratively REweighted (PIRE) algorithm for solving a general problem, which involves a large body of nonconvex sparse and structured sparse related problems. Comparing with previous iterative solvers for nonconvex sparse problem, PIRE is much more general and efficient. The computational cost of PIRE in each iteration is usually as low as the state-of-the-art convex solvers. We further propose the PIRE algorithm with Parallel Splitting (PIRE-PS) and PIRE algorithm with Alternative Updating (PIRE-AU) to handle the multi-variable problems. In theory, we prove that our proposed methods converge and any limit solution is a stationary point. Extensive experiments on both synthesis and real data sets demonstrate that our methods achieve comparative learning performance, but are much more efficient, by comparing with previous nonconvex solvers.
Cite
Text
Lu et al. "Proximal Iteratively Reweighted Algorithm with Multiple Splitting for Nonconvex Sparsity Optimization." AAAI Conference on Artificial Intelligence, 2014. doi:10.1609/AAAI.V28I1.8897Markdown
[Lu et al. "Proximal Iteratively Reweighted Algorithm with Multiple Splitting for Nonconvex Sparsity Optimization." AAAI Conference on Artificial Intelligence, 2014.](https://mlanthology.org/aaai/2014/lu2014aaai-proximal/) doi:10.1609/AAAI.V28I1.8897BibTeX
@inproceedings{lu2014aaai-proximal,
title = {{Proximal Iteratively Reweighted Algorithm with Multiple Splitting for Nonconvex Sparsity Optimization}},
author = {Lu, Canyi and Wei, Yunchao and Lin, Zhouchen and Yan, Shuicheng},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2014},
pages = {1251-1257},
doi = {10.1609/AAAI.V28I1.8897},
url = {https://mlanthology.org/aaai/2014/lu2014aaai-proximal/}
}