NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
Abstract
We present Neural Mixtures of Planar Experts (NeurMiPs), a novel planar-based scene representation for modeling geometry and appearance. NeurMiPs leverages a collection of local planar experts in 3D space as the scene representation. Each planar expert consists of the parameters of the local rectangular shape representing geometry and a neural radiance field modeling the color and opacity. We render novel views by calculating ray-plane intersections and composite output colors and densities at intersected points to the image. NeurMiPs blends the efficiency of explicit mesh rendering and flexibility of the neural radiance field. Experiments demonstrate that our proposed method achieves superior performance and speedup compared to other 3D representations for novel view synthesis.
Cite
Text
Lin et al. "NeurMiPs: Neural Mixture of Planar Experts for View Synthesis." Conference on Computer Vision and Pattern Recognition, 2022. doi:10.1109/CVPR52688.2022.01525Markdown
[Lin et al. "NeurMiPs: Neural Mixture of Planar Experts for View Synthesis." Conference on Computer Vision and Pattern Recognition, 2022.](https://mlanthology.org/cvpr/2022/lin2022cvpr-neurmips/) doi:10.1109/CVPR52688.2022.01525BibTeX
@inproceedings{lin2022cvpr-neurmips,
title = {{NeurMiPs: Neural Mixture of Planar Experts for View Synthesis}},
author = {Lin, Zhi-Hao and Ma, Wei-Chiu and Hsu, Hao-Yu and Wang, Yu-Chiang Frank and Wang, Shenlong},
booktitle = {Conference on Computer Vision and Pattern Recognition},
year = {2022},
pages = {15702-15712},
doi = {10.1109/CVPR52688.2022.01525},
url = {https://mlanthology.org/cvpr/2022/lin2022cvpr-neurmips/}
}