Tracking as Repeated Figure/Ground Segmentation
Abstract
Tracking over a long period of time is challenging as the appearance, shape and scale of the object in question may vary. We propose a paradigm of tracking by repeatedly segmenting figure from background. Accurate spatial support obtained in segmentation provides rich information about the track and enables reliable tracking of non-rigid objects without drifting. Figure/ground segmentation operates sequentially in each frame by utilizing both static image cues and temporal coherence cues, which include an appearance model of brightness (or color) and a spatial model propagating figure/ground masks through low-level region correspondence. A superpixel-based conditional random field linearly combines cues and loopy belief propagation is used to estimate marginal posteriors of figure vs background. We demonstrate our approach on long sequences of sports video, including figure skating and football.
Cite
Text
Ren and Malik. "Tracking as Repeated Figure/Ground Segmentation." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2007. doi:10.1109/CVPR.2007.383177Markdown
[Ren and Malik. "Tracking as Repeated Figure/Ground Segmentation." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2007.](https://mlanthology.org/cvpr/2007/ren2007cvpr-tracking/) doi:10.1109/CVPR.2007.383177BibTeX
@inproceedings{ren2007cvpr-tracking,
title = {{Tracking as Repeated Figure/Ground Segmentation}},
author = {Ren, Xiaofeng and Malik, Jitendra},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2007},
doi = {10.1109/CVPR.2007.383177},
url = {https://mlanthology.org/cvpr/2007/ren2007cvpr-tracking/}
}