Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection

Abstract

Medical imaging often contains critical fine-grained features, such as tumors or hemorrhages, which are crucial for diagnosis yet potentially too subtle for detection with conventional methods. In this paper, we introduce DIA, dissolving is amplifying. DIA is a fine-grained anomaly detection framework for medical images. First, we introduce dissolving transformations. We employ diffusion with a generative diffusion model as a dedicated feature-aware denoiser. Applying diffusion to medical images in a certain manner can remove or diminish fine-grained discriminative features. Second, we introduce an amplifying framework based on contrastive learning to learn a semantically meaningful representation of medical images in a self-supervised manner, with a focus on fine-grained features. The amplifying framework contrasts additional pairs of images with and without dissolving transformations applied and thereby emphasizes the dissolved fine-grained features. DIA significantly improves the medical anomaly detection performance with around 18.40% AUC boost against the baseline method and achieves an overall SOTA against other benchmark methods. Our code is available at https://github.com/shijianjian/DIA.git.

Cite

Text

Shi et al. "Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73202-7_22

Markdown

[Shi et al. "Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/shi2024eccv-dissolving/) doi:10.1007/978-3-031-73202-7_22

BibTeX

@inproceedings{shi2024eccv-dissolving,
  title     = {{Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection}},
  author    = {Shi, Jian and Zhang, Pengyi and Zhang, Ni and Ghazzai, Hakim and Wonka, Peter},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2024},
  doi       = {10.1007/978-3-031-73202-7_22},
  url       = {https://mlanthology.org/eccv/2024/shi2024eccv-dissolving/}
}