XCAT - Lightweight Quantized Single Image Super-Resolution Using Heterogeneous Group Convolutions and Cross Concatenation

Abstract

We propose a lightweight, single-image super-resolution mobile device network named XCAT, and introduce Heterogeneous Group Convolution Blocks with Cross Concatenations (HXBlock). The heterogeneous split of the input channels to the group convolution blocks reduces the number of operations, and cross concatenation allows for information flow between the intermediate input tensors of cascaded HXBlocks. Cross concatenations inside HXBlocks can also avoid using more expensive operations like 1  $\times $ ×  1 convolutions. To further prevent expensive tensor copy operations, XCAT utilizes non-trainable convolution kernels to apply upsampling operations. Designed with integer quantization in mind, XCAT also utilizes several techniques in training, like intensity-based data augmentation. Integer quantized XCAT operates in real-time on Mali-G71 MP2 GPU with 320 ms, and on Synaptics Dolphin NPU with 30 ms (NCHW) and 8.8 ms (NHWC), suitable for real-time applications.

Cite

Text

Ayazoglu and Bilecen. "XCAT - Lightweight Quantized Single Image Super-Resolution Using Heterogeneous Group Convolutions and Cross Concatenation." European Conference on Computer Vision Workshops, 2022. doi:10.1007/978-3-031-25063-7_29

Markdown

[Ayazoglu and Bilecen. "XCAT - Lightweight Quantized Single Image Super-Resolution Using Heterogeneous Group Convolutions and Cross Concatenation." European Conference on Computer Vision Workshops, 2022.](https://mlanthology.org/eccvw/2022/ayazoglu2022eccvw-xcat/) doi:10.1007/978-3-031-25063-7_29

BibTeX

@inproceedings{ayazoglu2022eccvw-xcat,
  title     = {{XCAT - Lightweight Quantized Single Image Super-Resolution Using Heterogeneous Group Convolutions and Cross Concatenation}},
  author    = {Ayazoglu, Mustafa and Bilecen, Bahri Batuhan},
  booktitle = {European Conference on Computer Vision Workshops},
  year      = {2022},
  pages     = {475-488},
  doi       = {10.1007/978-3-031-25063-7_29},
  url       = {https://mlanthology.org/eccvw/2022/ayazoglu2022eccvw-xcat/}
}