Border-SegGCN: Improving Semantic Segmentation by Refining the Border Outline Using Graph Convolutional Network

Abstract

We present Border-SegGCN, a novel architecture to improve semantic segmentation by refining the border outline using graph convolutional networks (GCN). The semantic segmentation network such as Unet or DeepLabV3+ is used as a base network to have pre-segmented output. This output is converted into a graphical structure and fed into the GCN to improve the border pixel prediction of the presegmented output. We explored and studied the factors such as border thickness, number of edges for a node, and the number of features to be fed into the GCN by performing experiments. We demonstrate the effectiveness of the BorderSegGCN on the CamVid and Carla dataset, achieving a test set performance of 81.96% without any post-processing on CamVid dataset. It is higher than the reported state of the art mIoU achieved on CamVid dataset by 0.404%.

Cite

Text

Dhingra et al. "Border-SegGCN: Improving Semantic Segmentation by Refining the Border Outline Using Graph Convolutional Network." IEEE/CVF International Conference on Computer Vision Workshops, 2021. doi:10.1109/ICCVW54120.2021.00102

Markdown

[Dhingra et al. "Border-SegGCN: Improving Semantic Segmentation by Refining the Border Outline Using Graph Convolutional Network." IEEE/CVF International Conference on Computer Vision Workshops, 2021.](https://mlanthology.org/iccvw/2021/dhingra2021iccvw-borderseggcn/) doi:10.1109/ICCVW54120.2021.00102

BibTeX

@inproceedings{dhingra2021iccvw-borderseggcn,
  title     = {{Border-SegGCN: Improving Semantic Segmentation by Refining the Border Outline Using Graph Convolutional Network}},
  author    = {Dhingra, Naina and Chogovadze, George and Kunz, Andreas M.},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2021},
  pages     = {865-875},
  doi       = {10.1109/ICCVW54120.2021.00102},
  url       = {https://mlanthology.org/iccvw/2021/dhingra2021iccvw-borderseggcn/}
}