DANCE: Dual-View Distribution Alignment for Dataset Condensation

Abstract

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby significantly improving the inference speed of existing diffusion models. However, their efficiency remains limited when handling complex semantic regions due to the single-step inference. To address this limitation, we propose SAMSR, a semantic-guided diffusion framework that incorporates semantic segmentation masks into the sampling process. Specifically, we introduce the SAM-Noise Module, which refines Gaussian noise using segmentation masks to preserve spatial and semantic features. Furthermore, we develop a pixel-wise sampling strategy that dynamically adjusts the residual transfer rate and noise strength based on pixel-level semantic weights, prioritizing semantically rich regions during the diffusion process. To enhance model training, we also propose a semantic consistency loss, which aligns pixel-wise semantic weights between predictions and ground truth. Extensive experiments on both real-world and synthetic datasets demonstrate that SAMSR significantly improves perceptual quality and detail recovery, particularly in semantically complex images.

Cite

Text

Zhang et al. "DANCE: Dual-View Distribution Alignment for Dataset Condensation." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/186

Markdown

[Zhang et al. "DANCE: Dual-View Distribution Alignment for Dataset Condensation." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/zhang2024ijcai-dance/) doi:10.24963/ijcai.2024/186

BibTeX

@inproceedings{zhang2024ijcai-dance,
  title     = {{DANCE: Dual-View Distribution Alignment for Dataset Condensation}},
  author    = {Zhang, Hansong and Li, Shikun and Lin, Fanzhao and Wang, Weiping and Qian, Zhenxing and Ge, Shiming},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {1679-1687},
  doi       = {10.24963/ijcai.2024/186},
  url       = {https://mlanthology.org/ijcai/2024/zhang2024ijcai-dance/}
}