Joint Estimation of Deformable Motion and Photometric Parameters in Single View Video
Abstract
In this paper we present a method for joint deformation and illumination parameter estimation from monocular image sequences exploiting direct image information. We are particularly interested in augmented reality applications, where a new texture is rendered onto a moving and deforming surface in the original video in real-time. Realistic retexturing not only requires geometric registration but also photometric parameter retrieval for convincing illusion. The contribution of this paper lies in a method for deformable surface augmentation exploiting a combination of an extended optical flow equation with a mesh-based shape and illumination prior that allows simultaneous deformation and photometric parameter estimation. Taking into account the photometric part by relaxing the brightness constancy assumption of the estimation not only allows realistic augmentation results but also improves spatial tracking.
Cite
Text
Hilsmann and Eisert. "Joint Estimation of Deformable Motion and Photometric Parameters in Single View Video." IEEE/CVF International Conference on Computer Vision Workshops, 2009. doi:10.1109/ICCVW.2009.5457675Markdown
[Hilsmann and Eisert. "Joint Estimation of Deformable Motion and Photometric Parameters in Single View Video." IEEE/CVF International Conference on Computer Vision Workshops, 2009.](https://mlanthology.org/iccvw/2009/hilsmann2009iccvw-joint/) doi:10.1109/ICCVW.2009.5457675BibTeX
@inproceedings{hilsmann2009iccvw-joint,
title = {{Joint Estimation of Deformable Motion and Photometric Parameters in Single View Video}},
author = {Hilsmann, Anna and Eisert, Peter},
booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
year = {2009},
pages = {390-397},
doi = {10.1109/ICCVW.2009.5457675},
url = {https://mlanthology.org/iccvw/2009/hilsmann2009iccvw-joint/}
}