Segmentation and Tracking of Multiple Humans in Complex Situations

Abstract

Segmenting and tracking multiple humans is a challenging problem in complex situations in which extended occlusion, shadow and/or reflection exists. We tackle this problem with a 3D model-based approach. Our method includes two stages, segmentation (detection) and tracking. Human hypotheses are generated by shape analysis of the foreground blobs using a human shape model. The segmented human hypotheses are tracked with a Kalman filter with explicit handling of occlusion. Hypotheses are verified while being tracked for the first second or so. The verification is done by walking recognition using an articulated human walking model. We propose a new method to recognize walking using a motion template and temporal integration. Experiments show that our approach works robustly in very challenging sequences.

Cite

Text

Zhao et al. "Segmentation and Tracking of Multiple Humans in Complex Situations." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001. doi:10.1109/CVPR.2001.990958

Markdown

[Zhao et al. "Segmentation and Tracking of Multiple Humans in Complex Situations." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001.](https://mlanthology.org/cvpr/2001/zhao2001cvpr-segmentation/) doi:10.1109/CVPR.2001.990958

BibTeX

@inproceedings{zhao2001cvpr-segmentation,
  title     = {{Segmentation and Tracking of Multiple Humans in Complex Situations}},
  author    = {Zhao, Tao and Nevatia, Ramakant and Lv, Fengjun},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2001},
  pages     = {II:194-201},
  doi       = {10.1109/CVPR.2001.990958},
  url       = {https://mlanthology.org/cvpr/2001/zhao2001cvpr-segmentation/}
}