ML Anthology

Sequential Monte Carlo Fusion of Sound and Vision for Speaker Tracking

Jaco Vermaak, Michel Gangnet, Andrew Blake, Patrick Pérez
ICCV 2001 pp. 741-747
doi:10.1109/ICCV.2001.10089 /iccv/2001/vermaak2001iccv-sequential/

Abstract

Video telephony could be considerably enhanced by provision of a tracking system that allows freedom of movement to the speaker while maintaining a well-framed image, for transmission over limited bandwidth. Already commercial multi-microphone systems exist which track speaker direction in order to reject background noise. Stereo sound and vision are complementary modalities in that sound is good for initialisation (where vision is expensive) whereas vision is good for localisation (where sound is less precise). Using generative probabilistic models and particle filtering, we show that stereo sound and vision can indeed be fused effectively, to make a system more capable than with either modality on its own.

ICCV Semantic Scholar

Cite

Text

Vermaak et al. "Sequential Monte Carlo Fusion of Sound and Vision for Speaker Tracking." IEEE/CVF International Conference on Computer Vision, 2001. doi:10.1109/ICCV.2001.10089

Markdown

[Vermaak et al. "Sequential Monte Carlo Fusion of Sound and Vision for Speaker Tracking." IEEE/CVF International Conference on Computer Vision, 2001.](https://mlanthology.org/iccv/2001/vermaak2001iccv-sequential/) doi:10.1109/ICCV.2001.10089

BibTeX

@inproceedings{vermaak2001iccv-sequential,
  title     = {{Sequential Monte Carlo Fusion of Sound and Vision for Speaker Tracking}},
  author    = {Vermaak, Jaco and Gangnet, Michel and Blake, Andrew and Pérez, Patrick},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year      = {2001},
  pages     = {741-747},
  doi       = {10.1109/ICCV.2001.10089},
  url       = {https://mlanthology.org/iccv/2001/vermaak2001iccv-sequential/}
}