Fall of Empires: Breaking Byzantine-Tolerant SGD by Inner Product Manipulation
Abstract
Recently, new defense techniques have been developed to tolerate Byzantine failures for distributed machine learning. The Byzantine model captures workers that behave arbitrarily, including malicious and compromised workers. In this paper, we break two prevailing Byzantine-tolerant techniques. Specifically we show that two robust aggregation methods for synchronous SGD–namely, coordinate-wise median and Krum–can be broken using new attack strategies based on inner product manipulation. We prove our results theoretically, as well as show empirical validation.
Cite
Text
Xie et al. "Fall of Empires: Breaking Byzantine-Tolerant SGD by Inner Product Manipulation." Uncertainty in Artificial Intelligence, 2019.Markdown
[Xie et al. "Fall of Empires: Breaking Byzantine-Tolerant SGD by Inner Product Manipulation." Uncertainty in Artificial Intelligence, 2019.](https://mlanthology.org/uai/2019/xie2019uai-fall/)BibTeX
@inproceedings{xie2019uai-fall,
title = {{Fall of Empires: Breaking Byzantine-Tolerant SGD by Inner Product Manipulation}},
author = {Xie, Cong and Koyejo, Oluwasanmi and Gupta, Indranil},
booktitle = {Uncertainty in Artificial Intelligence},
year = {2019},
pages = {261-270},
volume = {115},
url = {https://mlanthology.org/uai/2019/xie2019uai-fall/}
}