Cross-View Contrastive Fusion for Enhanced Molecular Property Prediction

Abstract

Federated Learning (FL) enables collaborative model training across distributed devices without sharing raw data. Hierarchical Federated Learning (HFL) is a new paradigm of FL that leverages the Edge Servers (ESs) layer as an intermediary to perform partial local model aggregation in proximity, reducing core network transmission overhead. However, HFL faces new challenges: (1) The two-stage aggregation process between client-edge and edge-cloud results in a dual-layer non-IID issue, which may significantly compromise model training accuracy. (2) The heterogeneity and mobility of clients further impact model training efficiency. To address these challenges, we propose a novel Clustered Semi-Asynchronous Hierarchical Federated Learning (CSAHFL) framework that integrates adaptive semi-asynchronous intra-cluster aggregation at client-edge layer and dynamic distribution-aware inter-cluster aggregation at edge-cloud layer, collaboratively enhancing model performance and scalability in heterogeneous and mobile environments. We conducte experiments under varying degrees of dual-layer non-IID in both static and high-mobility scenarios. The results demonstrate significant advantages of CSAHFL over representative state-of-the-art methods.

Cite

Text

Zheng et al. "Cross-View Contrastive Fusion for Enhanced Molecular Property Prediction." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/621

Markdown

[Zheng et al. "Cross-View Contrastive Fusion for Enhanced Molecular Property Prediction." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/zheng2024ijcai-cross/) doi:10.24963/ijcai.2024/621

BibTeX

@inproceedings{zheng2024ijcai-cross,
  title     = {{Cross-View Contrastive Fusion for Enhanced Molecular Property Prediction}},
  author    = {Zheng, Yan and Wu, Song and Lin, Junyu and Ren, Yazhou and He, Jing and Pu, Xiaorong and He, Lifang},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {5617-5625},
  doi       = {10.24963/ijcai.2024/621},
  url       = {https://mlanthology.org/ijcai/2024/zheng2024ijcai-cross/}
}