Modeling Fashion Compatibility with Explanation by Using Bidirectional LSTM

Kaicheng Pang, Xingxing Zou, Waikeung Wong

CVPRW 2021 pp. 3894-3898

doi:10.1109/CVPRW53098.2021.00432 /cvprw/2021/pang2021cvprw-modeling/

Abstract

The goal of this paper is to model the fashion compatibility of an outfit and provide the explanations. We first extract features of all attributes of all items via convolutional neural networks, and then train the bidirectional Long Short-term Memory (Bi-LSTM) model to learn the compatibility of an outfit by treating these attribute features as a sequence. Gradient penalty regularization is exploited for training inter-factor compatibility net which is used to compute the loss for judgment and provide its explanation which is generated from the recognized reasons related to the judgment. To train and evaluate the proposed approach, we expanded the EVALUATION3 dataset in terms of the number of items and attributes. Experiment results show that our approach can successfully evaluate compatibility with reason.

CVPRW Semantic Scholar

Cite

Text

Pang et al. "Modeling Fashion Compatibility with Explanation by Using Bidirectional LSTM." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2021. doi:10.1109/CVPRW53098.2021.00432

Markdown

[Pang et al. "Modeling Fashion Compatibility with Explanation by Using Bidirectional LSTM." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2021.](https://mlanthology.org/cvprw/2021/pang2021cvprw-modeling/) doi:10.1109/CVPRW53098.2021.00432

BibTeX

@inproceedings{pang2021cvprw-modeling,
  title     = {{Modeling Fashion Compatibility with Explanation by Using Bidirectional LSTM}},
  author    = {Pang, Kaicheng and Zou, Xingxing and Wong, Waikeung},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2021},
  pages     = {3894-3898},
  doi       = {10.1109/CVPRW53098.2021.00432},
  url       = {https://mlanthology.org/cvprw/2021/pang2021cvprw-modeling/}
}