FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on

Abstract

The recently proposed Novel Category Discovery (NCD) adapt paradigm of transductive learning hinders its application in more real-world scenarios. In fact, few labeled data in part of new categories can well alleviate this burden, which coincides with the ease that people can label few of new category data. Therefore, this paper presents a new setting in which a trained agent is able to flexibly switch between the tasks of identifying examples of known (labelled) classes and clustering novel (completely unlabeled) classes as the number of query examples increases by leveraging knowledge learned from only a few (handful) support examples. Drawing inspiration from the discovery of novel categories using prior-based clustering algorithms, we introduce a novel framework that further relaxes its assumptions to the real-world open set level by unifying the concept of model adaptability in few-shot learning. We refer to this setting as Few-Shot Novel Category Discovery (FSNCD) and propose Semi-supervised Hierarchical Clustering (SHC) and Uncertainty-aware K-means Clustering (UKC) to examine the model's reasoning capabilities. Extensive experiments and detailed analysis on five commonly used datasets demonstrate that our methods can achieve leading performance levels across different task settings and scenarios. Code is available at: https://github.com/Ashengl/FSNCD.

Cite

Text

Wang et al. "FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/151

Markdown

[Wang et al. "FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/wang2024ijcai-fldm/) doi:10.24963/ijcai.2024/151

BibTeX

@inproceedings{wang2024ijcai-fldm,
  title     = {{FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on}},
  author    = {Wang, Chenhui and Chen, Tao and Chen, Zhihao and Huang, Zhizhong and Jiang, Taoran and Wang, Qi and Shan, Hongming},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {1362-1370},
  doi       = {10.24963/ijcai.2024/151},
  url       = {https://mlanthology.org/ijcai/2024/wang2024ijcai-fldm/}
}