Federated Learning over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat
Abstract
We carefully evaluate a number of algorithms for learning in a federated environment, and test their utility for a variety of image classification tasks. We consider many issues that have not been adequately considered before: whether learning over data sets that do not have diverse sets of images affects the results; whether to use a pre-trained feature extraction "backbone"; how to evaluate learner performance (we argue that classification accuracy is not enough), among others. Overall, across a wide variety of settings, we find that vertically decomposing a neural network seems to give the best results, and outperforms more standard reconciliation-used methods.
Cite
Text
Hu et al. "Federated Learning over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat." International Conference on Computer Vision, 2023. doi:10.1109/ICCV51070.2023.01776Markdown
[Hu et al. "Federated Learning over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat." International Conference on Computer Vision, 2023.](https://mlanthology.org/iccv/2023/hu2023iccv-federated/) doi:10.1109/ICCV51070.2023.01776BibTeX
@inproceedings{hu2023iccv-federated,
title = {{Federated Learning over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat}},
author = {Hu, Erdong and Tang, Yuxin and Kyrillidis, Anastasios and Jermaine, Chris},
booktitle = {International Conference on Computer Vision},
year = {2023},
pages = {19385-19396},
doi = {10.1109/ICCV51070.2023.01776},
url = {https://mlanthology.org/iccv/2023/hu2023iccv-federated/}
}