ML Anthology

Integrating LDV Audio and IR Video for Remote Multimodal Surveillance

Zhigang Zhu, Weihong Li, George Wolberg
CVPRW 2005 pp. 10
doi:10.1109/CVPR.2005.478 /cvprw/2005/zhu2005cvprw-integrating/

Abstract

This paper describes a multimodal surveillance system for human signature detection. The system consists of three types of sensors: infrared (IR) cameras, pan/tilt/zoom (PTZ) color cameras and laser Doppler vibrometers (LDVs). The LDV is explored as a new non-contact remote voice detector. We have found that voice energy vibrates most objects and the vibrations can be detected by an LDV. Since signals captured by the LDV are very noisy, we have designed algorithms with Gaussian bandpass filtering and adaptive volume scaling to enhance the LDV voice signals. The enhanced voice signals are intelligible from targets without retro-reflective finishes at short or medium distances (<100m). By using retroreflective tapes, the distance could be as far as 300 meters. However, the manual operation to search and focus the laser beam on a target with both vibration and reflection is very difficult at medium and large distances. Therefore, infrared (IR) imaging for target selection and localization is also discussed. Future work remains in automatic LDV targeting and intelligent refocusing for long range LDV listening.

CVPRW Semantic Scholar

Cite

Text

Zhu et al. "Integrating LDV Audio and IR Video for Remote Multimodal Surveillance." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2005. doi:10.1109/CVPR.2005.478

Markdown

[Zhu et al. "Integrating LDV Audio and IR Video for Remote Multimodal Surveillance." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2005.](https://mlanthology.org/cvprw/2005/zhu2005cvprw-integrating/) doi:10.1109/CVPR.2005.478

BibTeX

@inproceedings{zhu2005cvprw-integrating,
  title     = {{Integrating LDV Audio and IR Video for Remote Multimodal Surveillance}},
  author    = {Zhu, Zhigang and Li, Weihong and Wolberg, George},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2005},
  pages     = {10},
  doi       = {10.1109/CVPR.2005.478},
  url       = {https://mlanthology.org/cvprw/2005/zhu2005cvprw-integrating/}
}