SegBlocks: Towards Block-Based Adaptive Resolution Networks for Fast Segmentation

Abstract

We propose a method to reduce the computational cost and memory consumption of existing neural networks, by exploiting spatial redundancies in images. Our method dynamically splits the image into blocks and processes low-complexity regions at a lower resolution. Our novel BlockPad module, implemented in CUDA, replaces zero-padding in order to prevent the discontinuities at patch borders of which existing methods suffer, while keeping memory consumption under control. We demonstrate SegBlocks on Cityscapes semantic segmentation, where the number of floating point operations is reduced by 30% with only 0.2% loss in accuracy (mIoU), and an inference speedup of 50% is achieved with 0.7% decrease in mIoU.

Cite

Text

Verelst and Tuytelaars. "SegBlocks: Towards Block-Based Adaptive Resolution Networks for Fast Segmentation." European Conference on Computer Vision Workshops, 2020. doi:10.1007/978-3-030-68238-5_2

Markdown

[Verelst and Tuytelaars. "SegBlocks: Towards Block-Based Adaptive Resolution Networks for Fast Segmentation." European Conference on Computer Vision Workshops, 2020.](https://mlanthology.org/eccvw/2020/verelst2020eccvw-segblocks/) doi:10.1007/978-3-030-68238-5_2

BibTeX

@inproceedings{verelst2020eccvw-segblocks,
  title     = {{SegBlocks: Towards Block-Based Adaptive Resolution Networks for Fast Segmentation}},
  author    = {Verelst, Thomas and Tuytelaars, Tinne},
  booktitle = {European Conference on Computer Vision Workshops},
  year      = {2020},
  pages     = {18-22},
  doi       = {10.1007/978-3-030-68238-5_2},
  url       = {https://mlanthology.org/eccvw/2020/verelst2020eccvw-segblocks/}
}