DCE-Diff: Diffusion Model for Synthesis of Early and Late Dynamic Contrast-Enhanced MR Images from Non-Contrast Multimodal Inputs

Abstract

Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) is pivotal in delineating abnormal lesions and cancerous regions in the anatomy of interest. However, DCE-MRI requires the injection of gadolinium (Gad)based contrast agents during acquisition which is known to have potential toxic effects, posing radiological concerns. Previous deep learning models employed for synthesizing DCE-MRI images consider unimodal structural MRI inputs lacking information about perfusion or perform early to late response predictions requiring Gad-based MRI sequences as input to drive the synthesis. In this work, we consider the heterogeneity in (i) the multimodal MRI structural inputs offering diverse and complementary anatomical features, (ii) the scanner settings and acquisition parameters, and (iii) the importance of incorporating the perfusion information in Apparent Diffusion Coefficient (ADC) data, which is essential to learn the hyperintense features for DCE-MRI synthesis. We propose DCE-diff, a deep generative diffusion model for multimodal image-to-image mapping from non-contrast structural MRI sequences and ADC maps to synthesize early and late response DCE-MRI images to circumvent Gad contrast injection to patients. Comparative studies using ProstateX and Prostate-MRI datasets against previous methods show that our model demonstrates (i) better synthesis quality with improvement margins of +0.85 dB in PSNR, +0.04 in SSIM, -22.8 in FID, and -0.02 in MAE (ii) better adaptability to different scanner data with deviated settings, showcasing a +8.7 dB improvement in PSNR, +0.22 in SSIM, -40.4 in FID, and -0.1 in MAE, and (iii) the importance of ADC maps in the DCE-MRI synthesis.

Cite

Text

M et al. "DCE-Diff: Diffusion Model for Synthesis of Early and Late Dynamic Contrast-Enhanced MR Images from Non-Contrast Multimodal Inputs." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024. doi:10.1109/CVPRW63382.2024.00525

Markdown

[M et al. "DCE-Diff: Diffusion Model for Synthesis of Early and Late Dynamic Contrast-Enhanced MR Images from Non-Contrast Multimodal Inputs." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.](https://mlanthology.org/cvprw/2024/m2024cvprw-dcediff/) doi:10.1109/CVPRW63382.2024.00525

BibTeX

@inproceedings{m2024cvprw-dcediff,
  title     = {{DCE-Diff: Diffusion Model for Synthesis of Early and Late Dynamic Contrast-Enhanced MR Images from Non-Contrast Multimodal Inputs}},
  author    = {M, Kishore Kumar and Ramanarayanan, Sriprabha and S, Sadhana and Sarkar, Arunima and Gayathri, Matcha Naga and Ram, Keerthi and Sivaprakasam, Mohanasankar},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2024},
  pages     = {5174-5183},
  doi       = {10.1109/CVPRW63382.2024.00525},
  url       = {https://mlanthology.org/cvprw/2024/m2024cvprw-dcediff/}
}