Non-Refractive Modulators for Encoding and Capturing Scene Appearance and Depth

Abstract

We analyze the modulation of a light field via non-refracting attenuators. In the most general case, any desired modulation can be achieved with attenuators having four degrees of freedom in ray-space. We motivate the discussion with a universal 4D ray modulator (ray-filter) which can attenuate the intensity of each ray independently. We describe operation of such a fantasy ray-filter in the context of altering the 4D light field incident on a 2D camera sensor. Ray-filters are difficult to realize in practice but we can achieve reversible encoding for light field capture using patterned attenuating mask. Two mask-based designs are analyzed in this framework. The first design closely mimics the angle-dependent ray-sorting possible with the ray filter. The second design exploits frequency-domain modulation to achieve a more efficient encoding. We extend these designs for optimal sampling of light field by matching the modulation function to the specific shape of the band-limit frequency transform of light field. We also show how a hand-held version of an attenuator based light field camera can be built using a medium-format digital camera and an inexpensive mask.

Cite

Text

Veeraraghavan et al. "Non-Refractive Modulators for Encoding and Capturing Scene Appearance and Depth." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2008. doi:10.1109/CVPR.2008.4587835

Markdown

[Veeraraghavan et al. "Non-Refractive Modulators for Encoding and Capturing Scene Appearance and Depth." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2008.](https://mlanthology.org/cvpr/2008/veeraraghavan2008cvpr-non/) doi:10.1109/CVPR.2008.4587835

BibTeX

@inproceedings{veeraraghavan2008cvpr-non,
  title     = {{Non-Refractive Modulators for Encoding and Capturing Scene Appearance and Depth}},
  author    = {Veeraraghavan, Ashok and Agrawal, Amit K. and Raskar, Ramesh and Mohan, Ankit and Tumblin, Jack},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2008},
  doi       = {10.1109/CVPR.2008.4587835},
  url       = {https://mlanthology.org/cvpr/2008/veeraraghavan2008cvpr-non/}
}