MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge

Abstract

Incomplete Multi-View Clustering (IMVC) aims to explore comprehensive representations from multiple views with missing samples. Recent studies have revealed that IMVC methods benefit from Graph Convolutional Network (GCN) in achieving robust feature imputation and effective representation learning. Despite these notable improvements, GCN imputation methods often cause a distribution shift between the imputed and original representations, particularly when the neighbors of the imputed nodes are assigned to different groups. Moreover, GCN learning methods tend to produce homogeneous imputed representations, which blur cluster boundaries and hinder effective discriminative clustering. To remedy these challenges, the Local Refinement and Global Realignment (LRGR) Self-supervised model is proposed for incomplete multi-view clustering, which includes two stages. In the first stage, a local imputed refinement module is designed to enhance the versatility of imputed representations through cross-view contrastive learning guided by view-specific prototypes. In the second stage, a global realignment module is introduced to achieve semantic consistency across views, alleviating distribution shifts by leveraging pseudo-labels and their corresponding confidence scores as guidance. Experiments on five widely used multi-view datasets demonstrate the competitiveness and superiority of our method compared to state-of-the-art approaches.

Cite

Text

Zhou et al. "MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/737

Markdown

[Zhou et al. "MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/zhou2024ijcai-multifaceteval/) doi:10.24963/ijcai.2024/737

BibTeX

@inproceedings{zhou2024ijcai-multifaceteval,
  title     = {{MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge}},
  author    = {Zhou, Yuxuan and Liu, Xien and Ning, Chen and Wu, Ji},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {6669-6677},
  doi       = {10.24963/ijcai.2024/737},
  url       = {https://mlanthology.org/ijcai/2024/zhou2024ijcai-multifaceteval/}
}