Shape and Motion Under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-View Stereo
Abstract
We present an algorithm for computing optical flow, shape, motion, lighting, and albedo from an image sequence of a rigidly-moving Lambertian object under distant illumination. The problem is formulated in a manner that subsumes structure from motion, multiview stereo, and photometric stereo as special cases. The algorithm utilizes both spatial and temporal intensity variation as cues: the former constrains flow and the latter constrains surface orientation; combining both cues enables dense reconstruction of both textured and textureless surfaces. The algorithm works by iteratively estimating affine camera parameters, illumination, shape, and albedo in an alternating fashion. Results are demonstrated on videos of hand-held objects moving in front of a fixed light and camera.
Cite
Text
Zhang et al. "Shape and Motion Under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-View Stereo." IEEE/CVF International Conference on Computer Vision, 2003. doi:10.1109/ICCV.2003.1238405Markdown
[Zhang et al. "Shape and Motion Under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-View Stereo." IEEE/CVF International Conference on Computer Vision, 2003.](https://mlanthology.org/iccv/2003/zhang2003iccv-shape/) doi:10.1109/ICCV.2003.1238405BibTeX
@inproceedings{zhang2003iccv-shape,
title = {{Shape and Motion Under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-View Stereo}},
author = {Zhang, Li and Curless, Brian and Hertzmann, Aaron and Seitz, Steven M.},
booktitle = {IEEE/CVF International Conference on Computer Vision},
year = {2003},
pages = {618-625},
doi = {10.1109/ICCV.2003.1238405},
url = {https://mlanthology.org/iccv/2003/zhang2003iccv-shape/}
}