Seeing in Extra Darkness Using a Deep-Red Flash

Jinhui Xiong, Jian Wang, Wolfgang Heidrich, Shree Nayar

CVPR 2021 pp. 10000-10009

doi:10.1109/CVPR46437.2021.00987 /cvpr/2021/xiong2021cvpr-seeing/

Abstract

We propose a new flash technique for low-light imaging, using deep-red light as an illuminating source. Our main observation is that in a dim environment, the human eye mainly uses rods for the perception of light, which are not sensitive to wavelengths longer than 620nm, yet the camera sensor still has a spectral response. We propose a novel modulation strategy when training a modern CNN model for guided image filtering, fusing a noisy RGB frame and a flash frame. This fusion network is further extended for video reconstruction. We have built a prototype with minor hardware adjustments and tested the new flash technique on a variety of static and dynamic scenes. The experimental results demonstrate that our method produces compelling reconstructions, even in extra dim conditions.

PDF CVPR Semantic Scholar

Cite

Text

Xiong et al. "Seeing in Extra Darkness Using a Deep-Red Flash." Conference on Computer Vision and Pattern Recognition, 2021. doi:10.1109/CVPR46437.2021.00987

Markdown

[Xiong et al. "Seeing in Extra Darkness Using a Deep-Red Flash." Conference on Computer Vision and Pattern Recognition, 2021.](https://mlanthology.org/cvpr/2021/xiong2021cvpr-seeing/) doi:10.1109/CVPR46437.2021.00987

BibTeX

@inproceedings{xiong2021cvpr-seeing,
  title     = {{Seeing in Extra Darkness Using a Deep-Red Flash}},
  author    = {Xiong, Jinhui and Wang, Jian and Heidrich, Wolfgang and Nayar, Shree},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2021},
  pages     = {10000-10009},
  doi       = {10.1109/CVPR46437.2021.00987},
  url       = {https://mlanthology.org/cvpr/2021/xiong2021cvpr-seeing/}
}