SoDaCam: Software-Defined Cameras via Single-Photon Imaging
Abstract
Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon-cubes represent the spatio-temporal detections of photons as a sequence of binary frames, at frame-rates as high as 100 kHz. We show that simple transformations of the photon-cube, or photon-cube projections, provide the functionality of numerous imaging systems including: exposure bracketing, flutter shutter cameras, video compressive systems, event cameras, and even cameras that move during exposure. Our photon-cube projections offer the flexibility of being software-defined constructs that are only limited by what is computable, and shot-noise. We exploit this flexibility to provide new capabilities for the emulated cameras. As an added benefit, our projections provide camera-dependent compression of photon-cubes, which we demonstrate using an implementation of our projections on a novel compute architecture that is designed for single-photon imaging.
Cite
Text
Sundar et al. "SoDaCam: Software-Defined Cameras via Single-Photon Imaging." International Conference on Computer Vision, 2023. doi:10.1109/ICCV51070.2023.00750Markdown
[Sundar et al. "SoDaCam: Software-Defined Cameras via Single-Photon Imaging." International Conference on Computer Vision, 2023.](https://mlanthology.org/iccv/2023/sundar2023iccv-sodacam/) doi:10.1109/ICCV51070.2023.00750BibTeX
@inproceedings{sundar2023iccv-sodacam,
title = {{SoDaCam: Software-Defined Cameras via Single-Photon Imaging}},
author = {Sundar, Varun and Ardelean, Andrei and Swedish, Tristan and Bruschini, Claudio and Charbon, Edoardo and Gupta, Mohit},
booktitle = {International Conference on Computer Vision},
year = {2023},
pages = {8165-8176},
doi = {10.1109/ICCV51070.2023.00750},
url = {https://mlanthology.org/iccv/2023/sundar2023iccv-sodacam/}
}