Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats

Abstract

We introduce a simple yet effective approach for separating transmitted and reflected light. Our key insight is that the powerful novel view synthesis capabilities provided by modern inverse rendering methods (e.g., 3D Gaussian splatting) allow one to perform flash/no-flash reflection separation using unpaired measurements—this relaxation dramatically simplifies image acquisition over conventional paired flash/no-flash reflection separation methods. Through extensive real-world experiments, we demonstrate our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D. Our method outperforms existing 3D reflection separation methods, which do not leverage illumination control, by a large margin.

Cite

Text

Xie et al. "Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73007-8_8

Markdown

[Xie et al. "Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/xie2024eccv-flashsplat/) doi:10.1007/978-3-031-73007-8_8

BibTeX

@inproceedings{xie2024eccv-flashsplat,
  title     = {{Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats}},
  author    = {Xie, Mingyang and Cai, Haoming and Shah, Sachin and Xu, Yiran and Feng, Brandon Y. and Huang, Jia-Bin and Metzler, Christopher A.},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2024},
  doi       = {10.1007/978-3-031-73007-8_8},
  url       = {https://mlanthology.org/eccv/2024/xie2024eccv-flashsplat/}
}