Multimodal Representation Distribution Learning for Medical Image Segmentation

Abstract

Collaborative spatial crowdsourcing leverages distributed workers' collective intelligence to accomplish spatial tasks. A central challenge is to efficiently assign suitable workers to collaborate on these tasks. Although mainstream reinforcement learning (RL) methods have proven effective in task allocation, they face two key obstacles: delayed reward feedback and non-stationary data distributions, both hindering optimal allocation and collaborative efficiency. To address these limitations, we propose CAFE (credit assignment and fine-tuning enhanced), a novel multi-agent RL framework for spatial crowdsourcing. CAFE introduces a credit assignment mechanism that distributes rewards based on workers' contributions and spatiotemporal constraints, coupled with bi-level meta-optimization to jointly optimize credit assignment and RL policy. To handle non-stationary spatial task distributions, CAFE employs an adaptive fine-tuning procedure that efficiently adjusts credit assignment parameters while preserving collaborative knowledge. Experiments on two real-world datasets validate the effectiveness of our framework, demonstrating superior performance in terms of task completion and equitable reward redistribution.

Cite

Text

Huang et al. "Multimodal Representation Distribution Learning for Medical Image Segmentation." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/459

Markdown

[Huang et al. "Multimodal Representation Distribution Learning for Medical Image Segmentation." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/huang2024ijcai-multimodal/) doi:10.24963/ijcai.2024/459

BibTeX

@inproceedings{huang2024ijcai-multimodal,
  title     = {{Multimodal Representation Distribution Learning for Medical Image Segmentation}},
  author    = {Huang, Chao and Cai, Weichao and Jiang, Qiuping and Wang, Zhihua},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {4156-4164},
  doi       = {10.24963/ijcai.2024/459},
  url       = {https://mlanthology.org/ijcai/2024/huang2024ijcai-multimodal/}
}