Deep Convolutional Sparse Coding Networks for Interpretable Image Fusion

Abstract

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents CSCFuse, which contains three deep convolutional sparse coding (CSC) networks for three kinds of image fusion tasks (i.e., infrared and visible image fusion, multi-exposure image fusion, and multi-spectral image fusion). The CSC model and the iterative shrinkage and thresholding algorithm are generalized into dictionary convolution units. As a result, all hyper-parameters are learned from data. Our extensive experiments and comprehensive comparisons reveal the superiority of CSCF use with regard to quantitative evaluation and visual inspection.

Cite

Text

Zhao et al. "Deep Convolutional Sparse Coding Networks for Interpretable Image Fusion." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023. doi:10.1109/CVPRW59228.2023.00234

Markdown

[Zhao et al. "Deep Convolutional Sparse Coding Networks for Interpretable Image Fusion." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023.](https://mlanthology.org/cvprw/2023/zhao2023cvprw-deep/) doi:10.1109/CVPRW59228.2023.00234

BibTeX

@inproceedings{zhao2023cvprw-deep,
  title     = {{Deep Convolutional Sparse Coding Networks for Interpretable Image Fusion}},
  author    = {Zhao, Zixiang and Zhang, Jiang-She and Bai, Haowen and Wang, Yicheng and Cui, Yukun and Deng, Lilun and Sun, Kai and Zhang, Chunxia and Liu, Junmin and Xu, Shuang},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2023},
  pages     = {2369-2377},
  doi       = {10.1109/CVPRW59228.2023.00234},
  url       = {https://mlanthology.org/cvprw/2023/zhao2023cvprw-deep/}
}