Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms
Abstract
The energy efficiency of deep spiking neural networks (SNNs) aligns with the constraints of resource-limited edge devices, positioning SNNs as a promising foundation for intelligent applications leveraging the extensive data collected by these devices. To safeguard data privacy, federated learning (FL) facilitates collaborative SNN-based model training by leveraging data distributed across edge devices without transmitting local data to a central server. However, existing FL approaches encounter challenges in handling label-skewed data across devices, inducing drift in the local SNN model and consequently impairing the performance of the global SNN model. To tackle these problems, we propose a novel framework called FedLEC, which incorporates intra-client label weight calibration to balance the learning intensity across local labels and inter-client knowledge distillation to mitigate local SNN model bias caused by label absence. Extensive experiments with three different structured SNNs across five datasets (i.e., three non-neuromorphic and two neuromorphic datasets) demonstrate the efficiency of FedLEC. Compared to seven state-of-the-art FL algorithms, FedLEC achieves an average accuracy improvement of approximately 11.59% for the global SNN model under various label skew distribution settings.
Cite
Text
Lehre and Lin. "Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/767Markdown
[Lehre and Lin. "Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/lehre2024ijcai-concentration/) doi:10.24963/ijcai.2024/767BibTeX
@inproceedings{lehre2024ijcai-concentration,
title = {{Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms}},
author = {Lehre, Per Kristian and Lin, Shishen},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2024},
pages = {6940-6948},
doi = {10.24963/ijcai.2024/767},
url = {https://mlanthology.org/ijcai/2024/lehre2024ijcai-concentration/}
}