Variational Inference in Similarity Spaces: A Bayesian Approach to Personalized Federated Learning

Abstract

Similarity space (or S-space) employs an encoder function, fed by labeled original pairwise data, to find a latent pairwise space with markers (prototypical) vector. It divides the space into regions where pairs of objects are either similar or dissimilar. This paper enhances S-space, equipping variational inference from personalized federated learning. The S-space representation aligns local representation spaces across clients, while variational inference improves generalization and reduces overfitting caused by data scarcity and client heterogeneity. Our theoretical analysis improved upper bounds on KL divergence between optimal local and optimal global variational models compared to traditional distributed Bayesian neural networks.

PDF NeurIPSW OpenReview Semantic Scholar

Cite

Text

Barros et al. "Variational Inference in Similarity Spaces: A Bayesian Approach to Personalized Federated Learning." NeurIPS 2024 Workshops: BDU, 2024.

Markdown

[Barros et al. "Variational Inference in Similarity Spaces: A Bayesian Approach to Personalized Federated Learning." NeurIPS 2024 Workshops: BDU, 2024.](https://mlanthology.org/neuripsw/2024/barros2024neuripsw-variational/)

BibTeX

@inproceedings{barros2024neuripsw-variational,
  title     = {{Variational Inference in Similarity Spaces: A Bayesian Approach to Personalized Federated Learning}},
  author    = {Barros, Pedro H and Murai, Fabricio and Houmansadr, Amir and Frery, Alejandro C. and Filho, Heitor Soares Ramos},
  booktitle = {NeurIPS 2024 Workshops: BDU},
  year      = {2024},
  url       = {https://mlanthology.org/neuripsw/2024/barros2024neuripsw-variational/}
}