Joint 3D Tracking of a Deformable Object in Interaction with a Hand
Abstract
We present a novel method that is able to track a complex deformable object in interaction with a hand. This is achieved by formulating and solving an optimization problem that jointly considers the hand, the deformable object and the hand/object contact points. The optimization evaluates several hand/object contact configuration hypotheses and adopts the one that results in the best fit of the object's model to the available RGBD observations in the vicinity of the hand. Thus, the hand is not treated as a distractor that occludes parts of the deformable object, but as a source of valuable information. Experimental results on a dataset that has been developed specifically for this new problem illustrate the superior performance of the proposed approach against relevant, state of the art solutions.
Cite
Text
Tsoli and Argyros. "Joint 3D Tracking of a Deformable Object in Interaction with a Hand." Proceedings of the European Conference on Computer Vision (ECCV), 2018. doi:10.1007/978-3-030-01264-9_30Markdown
[Tsoli and Argyros. "Joint 3D Tracking of a Deformable Object in Interaction with a Hand." Proceedings of the European Conference on Computer Vision (ECCV), 2018.](https://mlanthology.org/eccv/2018/tsoli2018eccv-joint/) doi:10.1007/978-3-030-01264-9_30BibTeX
@inproceedings{tsoli2018eccv-joint,
title = {{Joint 3D Tracking of a Deformable Object in Interaction with a Hand}},
author = {Tsoli, Aggeliki and Argyros, Antonis A.},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
year = {2018},
doi = {10.1007/978-3-030-01264-9_30},
url = {https://mlanthology.org/eccv/2018/tsoli2018eccv-joint/}
}