FedFa: A Fully Asynchronous Training Paradigm for Federated Learning
Abstract
The task of graph-level out-of-distribution (OOD) detection is crucial for deploying graph neural networks in real-world settings. In this paper, we observe a significant difference in the relationship between the largest and second-largest eigenvalues of the Laplacian matrix for in-distribution (ID) and OOD graph samples: OOD samples often exhibit anomalous spectral gaps (the difference between the largest and second-largest eigenvalues). This observation motivates us to propose SpecGap, an effective post-hoc approach for OOD detection on graphs. SpecGap adjusts features by subtracting the component associated with the second-largest eigenvalue, scaled by the spectral gap, from the high-level features (i.e., X - (λn - λn-1) u_n-1 v_n-1^T). SpecGap achieves state-of-the-art performance across multiple benchmark datasets. We present extensive ablation studies and comprehensive theoretical analyses to support our empirical results. As a parameter-free post-hoc method, SpecGap can be easily integrated into existing graph neural network models without requiring any additional training or model modification.
Cite
Text
Xu et al. "FedFa: A Fully Asynchronous Training Paradigm for Federated Learning." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/584Markdown
[Xu et al. "FedFa: A Fully Asynchronous Training Paradigm for Federated Learning." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/xu2024ijcai-fedfa/) doi:10.24963/ijcai.2024/584BibTeX
@inproceedings{xu2024ijcai-fedfa,
title = {{FedFa: A Fully Asynchronous Training Paradigm for Federated Learning}},
author = {Xu, Haotian and Zhang, Zhaorui and Di, Sheng and Liu, Benben and Alharthi, Khalid Ayedh and Cao, Jiannong},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2024},
pages = {5281-5288},
doi = {10.24963/ijcai.2024/584},
url = {https://mlanthology.org/ijcai/2024/xu2024ijcai-fedfa/}
}