ViS-HuD: Using Visual Saliency to Improve Human Detection with Convolutional Neural Networks

Abstract

The paper presents a technique to improve human detection in still images using deep learning. Our novel method, ViS-HuD, computes visual saliency map from the image. Then the input image is multiplied by the map and product is fed to the Convolutional Neural Network (CNN) which detects humans in the image. A visual saliency map is generated using ML-Net and human detection is carried out using DetectNet. ML-Net is pre-trained on SALICON while, DetectNet is pre-trained on ImageNet database for visual saliency detection and image classification respectively. The CNNs of ViS-HuD were trained on two challenging databases - Penn Fudan and TUD-Brussels Benchmark. Experimental results demonstrate that the proposed method achieves state-of-the-art performance on Penn Fudan Dataset with 91.4% human detection accuracy and it achieves average miss-rate of 53% on the TUD-Brussels benchmark.

Cite

Text

Gajjar et al. "ViS-HuD: Using Visual Saliency to Improve Human Detection with Convolutional Neural Networks." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018. doi:10.1109/CVPRW.2018.00256

Markdown

[Gajjar et al. "ViS-HuD: Using Visual Saliency to Improve Human Detection with Convolutional Neural Networks." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018.](https://mlanthology.org/cvprw/2018/gajjar2018cvprw-vishud/) doi:10.1109/CVPRW.2018.00256

BibTeX

@inproceedings{gajjar2018cvprw-vishud,
  title     = {{ViS-HuD: Using Visual Saliency to Improve Human Detection with Convolutional Neural Networks}},
  author    = {Gajjar, Vandit and Khandhediya, Yash and Gurnani, Ayesha and Mavani, Viraj and Raval, Mehul S.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2018},
  pages     = {1908-1916},
  doi       = {10.1109/CVPRW.2018.00256},
  url       = {https://mlanthology.org/cvprw/2018/gajjar2018cvprw-vishud/}
}