SAD-GS: Shape-Aligned Depth-Supervised Gaussian Splatting

Abstract

This paper proposes SAD-GS, a depth-supervised Gaussian Splatting (GS) method that provides accurate 3D geometry reconstruction by introducing a shape-aligned depth supervision strategy. Depth information is widely used in various GS applications, such as dynamic scene reconstruction, real-time simultaneous lo-calization and mapping, and few-shot reconstruction. However, existing depth-supervised methods for GS all focus on the center and neglect the shape of Gaussians during training. This oversight can result in inaccurate surface geometry in the reconstruction and can harm downstream tasks like novel view synthesis, mesh reconstruction, and robot path planning. To address this, this paper proposes a shape-aligned loss, which aims to produce a smooth and precise reconstruction by adding extra constraints to the Gaussian shape. The proposed method is evaluated qualitatively and quantitatively on two publicly available datasets. The evaluation demonstrates that the proposed method provides state-of-the-art novel view rendering quality and mesh accuracy compared to existing depth-supervised GS methods. A project page is available at https://umauto-bots.github.io/sad_gs.

Cite

Text

Kung et al. "SAD-GS: Shape-Aligned Depth-Supervised Gaussian Splatting." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024. doi:10.1109/CVPRW63382.2024.00290

Markdown

[Kung et al. "SAD-GS: Shape-Aligned Depth-Supervised Gaussian Splatting." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.](https://mlanthology.org/cvprw/2024/kung2024cvprw-sadgs/) doi:10.1109/CVPRW63382.2024.00290

BibTeX

@inproceedings{kung2024cvprw-sadgs,
  title     = {{SAD-GS: Shape-Aligned Depth-Supervised Gaussian Splatting}},
  author    = {Kung, Pou-Chun and Isaacson, Seth and Vasudevan, Ram and Skinner, Katherine A.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2024},
  pages     = {2842-2851},
  doi       = {10.1109/CVPRW63382.2024.00290},
  url       = {https://mlanthology.org/cvprw/2024/kung2024cvprw-sadgs/}
}