PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects

Abstract

Neural implicit surface reconstruction has achieved remarkable progress recently. Despite resorting to complex radiance modeling, state-of-the-art methods still struggle with textureless and specular surfaces. Different from RGB images, polarization images can provide direct constraints on the azimuth angles of the surface normals. In this paper, we present PISR, a novel method that utilizes a geometrically accurate polarimetric loss to refine shape independently of appearance. In addition, PISR smooths surface normals in image space to eliminate severe shape distortions and leverages the hash-grid-based neural signed distance function to accelerate the reconstruction. Experimental results demonstrate that PISR achieves higher accuracy and robustness, with an L1 Chamfer distance of 0.5 mm and an F-score of 99.5% at 1 mm, while converging 4 ∼ 30× faster than previous polarimetric surface reconstruction methods. The source code is available at https://github.com/GCChen97/PISR

Cite

Text

Chen et al. "PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73242-3_12

Markdown

[Chen et al. "PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/chen2024eccv-pisr/) doi:10.1007/978-3-031-73242-3_12

BibTeX

@inproceedings{chen2024eccv-pisr,
  title     = {{PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects}},
  author    = {Chen, Guangcheng and He, Yicheng and He, Li and Zhang, Hong},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2024},
  doi       = {10.1007/978-3-031-73242-3_12},
  url       = {https://mlanthology.org/eccv/2024/chen2024eccv-pisr/}
}