Illumination-Invariant Robust Multiview 3D Human Motion Capture

Abstract

In this work we address the problem of capturing human body motion under changing lighting conditions in a multiview setup. In order to account for changing lighting conditions we propose to use an intermediate image representation that is invariant to the scene lighting. In our approach this is achieved by solving time-varying segmentation problems that use frame- and view-dependent appearance costs that are able to adjust to the present conditions. Moreover, we use an adaptive combination of our lighting-invariant segmentation with CNN-based joint detectors in order to increase the robustness to segmentation errors. In our experimental validation we demonstrate that our method is able to handle difficult conditions better than existing works.

Cite

Text

Robertini et al. "Illumination-Invariant Robust Multiview 3D Human Motion Capture." IEEE/CVF Winter Conference on Applications of Computer Vision, 2018. doi:10.1109/WACV.2018.00185

Markdown

[Robertini et al. "Illumination-Invariant Robust Multiview 3D Human Motion Capture." IEEE/CVF Winter Conference on Applications of Computer Vision, 2018.](https://mlanthology.org/wacv/2018/robertini2018wacv-illumination/) doi:10.1109/WACV.2018.00185

BibTeX

@inproceedings{robertini2018wacv-illumination,
  title     = {{Illumination-Invariant Robust Multiview 3D Human Motion Capture}},
  author    = {Robertini, Nadia and Bernard, Florian and Xu, Weipeng and Theobalt, Christian},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2018},
  pages     = {1661-1670},
  doi       = {10.1109/WACV.2018.00185},
  url       = {https://mlanthology.org/wacv/2018/robertini2018wacv-illumination/}
}