Computer Vision for the Visually Impaired: The Sound of Vision System

Abstract

This paper presents a computer vision based sensory substitution device for the visually impaired. Its main objective is to provide the users with a 3D representation of the environment around them, conveyed by means of the hearing and tactile senses. One of the biggest challenges for this system is to ensure pervasiveness, i.e., to be usable in any indoor or outdoor environments and in any illumination conditions. This work reveals both the hardware (3D acquisition system) and software (3D processing pipeline) used for developing this sensory substitution device and provides insight on its exploitation in various scenarios. Preliminary experiments with blind users revealed good usability results and provided valuable feedback for system improvement.

Cite

Text

Caraiman et al. "Computer Vision for the Visually Impaired: The Sound of Vision System." IEEE/CVF International Conference on Computer Vision Workshops, 2017. doi:10.1109/ICCVW.2017.175

Markdown

[Caraiman et al. "Computer Vision for the Visually Impaired: The Sound of Vision System." IEEE/CVF International Conference on Computer Vision Workshops, 2017.](https://mlanthology.org/iccvw/2017/caraiman2017iccvw-computer/) doi:10.1109/ICCVW.2017.175

BibTeX

@inproceedings{caraiman2017iccvw-computer,
  title     = {{Computer Vision for the Visually Impaired: The Sound of Vision System}},
  author    = {Caraiman, Simona and Morar, Anca and Owczarek, Mateusz and Burlacu, Adrian and Rzeszotarski, Dariusz and Botezatu, Nicolae and Herghelegiu, Paul and Moldoveanu, Florica and Strumillo, Pawel and Moldoveanu, Alin},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2017},
  pages     = {1480-1489},
  doi       = {10.1109/ICCVW.2017.175},
  url       = {https://mlanthology.org/iccvw/2017/caraiman2017iccvw-computer/}
}