TRIKOP: Exploring Visual Prompting Paradigms for Multi-Grade Knee Osteoarthritis Classification on MRI Images
Abstract
Knee osteoarthritis (KOA) is a degenerative joint disease that significantly impacts quality of life. While transfer learning shows promise in medical imaging, its application to KOA diagnosis remains challenging due to medical data's unique characteristics. To address this, we propose TRIKOP, a framework leveraging Visual Prompting for KOA diagnosis on MRI. Our approach explores three prompt-generating strategies that extract clinically relevant information from input images. Each prompt type is encoded using a tailored method to integrate effectively into the Vision Transformer for optimal representation. Among them, the contrastive embedding prompting strategy achieves 63.04% accuracy on the OAI dataset, surpassing prior studies. Moreover, TRIKOP produces attention maps highlighting diagnostically significant regions, improving model interpretability. This work highlights TRIKOP’s potential to improve AI-driven KOA diagnosis and clinical support.
Cite
Text
Phan et al. "TRIKOP: Exploring Visual Prompting Paradigms for Multi-Grade Knee Osteoarthritis Classification on MRI Images." International Joint Conference on Artificial Intelligence, 2025. doi:10.24963/IJCAI.2025/1270Markdown
[Phan et al. "TRIKOP: Exploring Visual Prompting Paradigms for Multi-Grade Knee Osteoarthritis Classification on MRI Images." International Joint Conference on Artificial Intelligence, 2025.](https://mlanthology.org/ijcai/2025/phan2025ijcai-trikop/) doi:10.24963/IJCAI.2025/1270BibTeX
@inproceedings{phan2025ijcai-trikop,
title = {{TRIKOP: Exploring Visual Prompting Paradigms for Multi-Grade Knee Osteoarthritis Classification on MRI Images}},
author = {Phan, Hieu and Pham, Hung and Nguyen, Dat and Le, Khoa and Nguyen, Tuan and Tran, Triet and Quan, Tho},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2025},
pages = {11095-11099},
doi = {10.24963/IJCAI.2025/1270},
url = {https://mlanthology.org/ijcai/2025/phan2025ijcai-trikop/}
}