Using Vision Based Tracking to Support Real-Time Graphical Instruction for Students Who Have Visual Impairments
Abstract
In this paper, we describe a real-time vision-based tracking system to help students who are blind or visually impaired (SBVI) to follow instructional discourse that employs graphical illustrations. The vision system employs a color model based tracking for both the instructor's pointing behavior and the SBVI's reading behavior, and maps the pointing positions into the same coordinates. Our Haptic Deictic System - HDS system also employs a haptic glove to provide SBVI access to the situated pointing behavior of instructor that is performed in conjunction with speech, and provides the instructor real-time visual feedback on the SBVI's reading actions. Thus, our system supports two-way situated multimodal communication. In this paper, we first introduce our system, and then we discuss studies that show the efficacy of our approach.
Cite
Text
Fang et al. "Using Vision Based Tracking to Support Real-Time Graphical Instruction for Students Who Have Visual Impairments." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2010. doi:10.1109/CVPRW.2010.5543588Markdown
[Fang et al. "Using Vision Based Tracking to Support Real-Time Graphical Instruction for Students Who Have Visual Impairments." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2010.](https://mlanthology.org/cvprw/2010/fang2010cvprw-using/) doi:10.1109/CVPRW.2010.5543588BibTeX
@inproceedings{fang2010cvprw-using,
title = {{Using Vision Based Tracking to Support Real-Time Graphical Instruction for Students Who Have Visual Impairments}},
author = {Fang, Bing and Oliveira, Francisco and Quek, Francis K. H.},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2010},
pages = {9-14},
doi = {10.1109/CVPRW.2010.5543588},
url = {https://mlanthology.org/cvprw/2010/fang2010cvprw-using/}
}