Simultaneous Identification and Tracking of Multiple People Using Video and IMUs
Abstract
Most modern approaches for multiple people tracking rely on human appearance to exploit similarity between person detections. In this work we propose an alternative tracking method that does not depend on visual appearance and is still capable to deal with very dynamic motions and long-term occlusions. We make this feasible by: (i) incorporating additional information from body-worn inertial sensors, (ii) designing a neural network to relate person detections to orientation measurements and (iii) formulating a graph labeling problem to obtain a tracking solution that is globally consistent with the video and inertial recordings. We evaluate our approach on several challenging tracking sequences and achieve a very high IDF1 score of 91.2%. We outperform appearance-based baselines in scenarios where appearance is less informative and are on-par in situations with discriminative people appearance.
Cite
Text
Henschel et al. "Simultaneous Identification and Tracking of Multiple People Using Video and IMUs." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019. doi:10.1109/CVPRW.2019.00106Markdown
[Henschel et al. "Simultaneous Identification and Tracking of Multiple People Using Video and IMUs." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.](https://mlanthology.org/cvprw/2019/henschel2019cvprw-simultaneous/) doi:10.1109/CVPRW.2019.00106BibTeX
@inproceedings{henschel2019cvprw-simultaneous,
title = {{Simultaneous Identification and Tracking of Multiple People Using Video and IMUs}},
author = {Henschel, Roberto and von Marcard, Timo and Rosenhahn, Bodo},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2019},
pages = {780-789},
doi = {10.1109/CVPRW.2019.00106},
url = {https://mlanthology.org/cvprw/2019/henschel2019cvprw-simultaneous/}
}