Scalable Nonnegative Matrix Factorization with Block-Wise Updates
Abstract
Nonnegative Matrix Factorization (NMF) has been applied with great success to many applications. As NMF is applied to massive datasets such as web-scale dyadic data, it is desirable to leverage a cluster of machines to speed up the factorization. However, it is challenging to efficiently implement NMF in a distributed environment. In this paper, we show that by leveraging a new form of update functions, we can perform local aggregation and fully explore parallelism. Moreover, under the new form of update functions, we can perform frequent updates, which aim to use the most recently updated data whenever possible. As a result, frequent updates are more efficient than their traditional concurrent counterparts. Through a series of experiments on a local cluster as well as the Amazon EC2 cloud, we demonstrate that our implementation with frequent updates is up to two orders of magnitude faster than the existing implementation with the traditional form of update functions.
Cite
Text
Yin et al. "Scalable Nonnegative Matrix Factorization with Block-Wise Updates." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2014. doi:10.1007/978-3-662-44845-8_22Markdown
[Yin et al. "Scalable Nonnegative Matrix Factorization with Block-Wise Updates." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2014.](https://mlanthology.org/ecmlpkdd/2014/yin2014ecmlpkdd-scalable/) doi:10.1007/978-3-662-44845-8_22BibTeX
@inproceedings{yin2014ecmlpkdd-scalable,
title = {{Scalable Nonnegative Matrix Factorization with Block-Wise Updates}},
author = {Yin, Jiangtao and Gao, Lixin and Zhang, Zhongfei (Mark)},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2014},
pages = {337-352},
doi = {10.1007/978-3-662-44845-8_22},
url = {https://mlanthology.org/ecmlpkdd/2014/yin2014ecmlpkdd-scalable/}
}