Hypernetworks for Generalizable BRDF Representation

Abstract

In this paper, we introduce a technique to estimate measured BRDFs from a sparse set of samples. Our approach offers accurate BRDF reconstructions that are generalizable to new materials. This opens the door to BRDF reconstructions from a variety of data sources. The success of our approach relies on the ability of hypernetworks to generate a robust representation of BRDFs and a set encoder that allows us to feed inputs of different sizes to the architecture. The set encoder and the hypernetwork also enable the compression of densely sampled BRDFs. We evaluate our technique both qualitatively and quantitatively on the well-known MERL dataset of 100 isotropic materials. Our approach accurately 1) estimates the BRDFs of unseen materials even for an extremely sparse sampling, 2) compresses the measured BRDFs into very small embeddings, e.g., 7D.

Cite

Text

Gokbudak et al. "Hypernetworks for Generalizable BRDF Representation." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73116-7_5

Markdown

[Gokbudak et al. "Hypernetworks for Generalizable BRDF Representation." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/gokbudak2024eccv-hypernetworks/) doi:10.1007/978-3-031-73116-7_5

BibTeX

@inproceedings{gokbudak2024eccv-hypernetworks,
  title     = {{Hypernetworks for Generalizable BRDF Representation}},
  author    = {Gokbudak, Fazilet and Sztrajman, Alejandro and Zhou, Chenliang and Zhong, Fangcheng and Mantiuk, Rafal and Oztireli, A. Cengiz},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2024},
  doi       = {10.1007/978-3-031-73116-7_5},
  url       = {https://mlanthology.org/eccv/2024/gokbudak2024eccv-hypernetworks/}
}