Large Language Model Based Multi-Agents: A Survey of Progress and Challenges

Abstract

Arrhythmia diagnosis using electrocardiogram (ECG) is critical for preventing cardiovascular risks. However, existing deep learning-based methods struggle with label scarcity and contrastive learning-based methods suffer from false-negative samples, which lead to poor model generalization. Besides, due to inter-subject variability, pre-trained models cannot achieve evenly performance across individuals. Conducting model fine-tuning for each individual is computationally expensive and does not guarantee improvement. We propose DiffECG, a diffusion-based self-supervised learning framework for label-efficient and personalized arrhythmia detection. Our method utilizes a diffusion model to extract robust ECG representations, coupled with a novel feature extractor and a multi-modal feature fusion strategy to obtain a well-generalized model. Moreover, we propose an efficient model personalization mechanism based on zeroth-order optimization. It personalizes the model by tuning the noise-adding step t in the diffusion process, significantly reducing computational costs compared to model fine-tuning. Experimental results show that our proposed method outperforms the SOTA method by 37.9% and 23.9% in generalization and personalization performance, respectively. The source code is available at: https://github.com/Auguuust/DiffEC

Cite

Text

Guo et al. "Large Language Model Based Multi-Agents: A Survey of Progress and Challenges." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/890

Markdown

[Guo et al. "Large Language Model Based Multi-Agents: A Survey of Progress and Challenges." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/guo2024ijcai-large/) doi:10.24963/ijcai.2024/890

BibTeX

@inproceedings{guo2024ijcai-large,
  title     = {{Large Language Model Based Multi-Agents: A Survey of Progress and Challenges}},
  author    = {Guo, Taicheng and Chen, Xiuying and Wang, Yaqi and Chang, Ruidi and Pei, Shichao and Chawla, Nitesh V. and Wiest, Olaf and Zhang, Xiangliang},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {8048-8057},
  doi       = {10.24963/ijcai.2024/890},
  url       = {https://mlanthology.org/ijcai/2024/guo2024ijcai-large/}
}