TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal

Hua-En Chang, Chia-Hsuan Hsieh, Hao-Hsiang Yang, I-Hsiang Chen, Yi-Chung Chen, Yu-Chiang Frank Wang, Zhi-Kai Huang, Wei-Ting Chen, Sy-Yen Kuo

CVPRW 2023 pp. 1436-1446

doi:10.1109/CVPRW59228.2023.00148 /cvprw/2023/chang2023cvprw-tsrformer/

Abstract

Single-image shadow removal aims to remove undesired shadow information from captured images. With the development of deep convolutional neural networks, several methods have been proposed to achieve promising performance in shadow removal. However, they still struggle with limited performance due to the non-homogeneous intensity distribution of the shadow. To address this issue, we propose a two-stage shadow removal architecture based on the transformer called TSRFormer. The proposed architecture is divided into shadow removal and content refinement networks. These two stages adopt different transformer architectures and remove the shadow based on different information to achieve effective shadow removal. Experiments performed on challenging benchmark show that the proposed model achieves the 2nd highest SSIM in the NTIRE 2023 Image Shadow Removal Challenge. The source code will be public after the acceptance of this paper.

CVPRW Semantic Scholar

Cite

Text

Chang et al. "TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023. doi:10.1109/CVPRW59228.2023.00148

Markdown

[Chang et al. "TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023.](https://mlanthology.org/cvprw/2023/chang2023cvprw-tsrformer/) doi:10.1109/CVPRW59228.2023.00148

BibTeX

@inproceedings{chang2023cvprw-tsrformer,
  title     = {{TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal}},
  author    = {Chang, Hua-En and Hsieh, Chia-Hsuan and Yang, Hao-Hsiang and Chen, I-Hsiang and Chen, Yi-Chung and Wang, Yu-Chiang Frank and Huang, Zhi-Kai and Chen, Wei-Ting and Kuo, Sy-Yen},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2023},
  pages     = {1436-1446},
  doi       = {10.1109/CVPRW59228.2023.00148},
  url       = {https://mlanthology.org/cvprw/2023/chang2023cvprw-tsrformer/}
}