ML Anthology

Inferring Light Fields from Shadows

Manel Baradad, Vickie Ye, Adam B. Yedidia, Frédo Durand, William T. Freeman, Gregory W. Wornell, Antonio Torralba
CVPR 2018
doi:10.1109/CVPR.2018.00656 /cvpr/2018/baradad2018cvpr-inferring/

Abstract

We present a method for inferring a 4D light field of a hidden scene from 2D shadows cast by a known occluder on a diffuse wall. We do this by determining how light naturally reflected off surfaces in the hidden scene interacts with the occluder. By modeling the light transport as a linear system, and incorporating prior knowledge about light field structures, we can invert the system to recover the hidden scene. We demonstrate results of our inference method across simulations and experiments with different types of occluders. For instance, using the shadow cast by a real house plant, we are able to recover low resolution light fields with different levels of texture and parallax complexity. We provide two experimental results: a human subject and two planar elements at different depths.

PDF CVPR Semantic Scholar

Cite

Text

Baradad et al. "Inferring Light Fields from Shadows." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018. doi:10.1109/CVPR.2018.00656

Markdown

[Baradad et al. "Inferring Light Fields from Shadows." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018.](https://mlanthology.org/cvpr/2018/baradad2018cvpr-inferring/) doi:10.1109/CVPR.2018.00656

BibTeX

@inproceedings{baradad2018cvpr-inferring,
  title     = {{Inferring Light Fields from Shadows}},
  author    = {Baradad, Manel and Ye, Vickie and Yedidia, Adam B. and Durand, Frédo and Freeman, William T. and Wornell, Gregory W. and Torralba, Antonio},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2018},
  doi       = {10.1109/CVPR.2018.00656},
  url       = {https://mlanthology.org/cvpr/2018/baradad2018cvpr-inferring/}
}