Face Typing: Vision-Based Perceptual Interface for Hands-Free Text Entry with a Scrollable Virtual Keyboard

Abstract

We present a novel vision-based perceptual user interface for hands-free text entry that utilizes face detection and visual gesture detection to manipulate a scrollable virtual keyboard. A thorough experimentation was undertaken to quantitatively define a performance of the interface in hands-free pointing, selection and scrolling tasks. The experiments were conducted with nine participants in laboratory conditions. Several face and head gestures were examined for detection robustness and user convenience. The system gave a reasonable performance in terms of high gesture detection rate and small false alarm rate. The participants reported that a new interface was easy to understand and operate. Encouraged by these results, we discuss advantages and constraints of the interface and suggest possibilities for design improvements.

Cite

Text

Gizatdinova et al. "Face Typing: Vision-Based Perceptual Interface for Hands-Free Text Entry with a Scrollable Virtual Keyboard." IEEE/CVF Winter Conference on Applications of Computer Vision, 2012. doi:10.1109/WACV.2012.6162997

Markdown

[Gizatdinova et al. "Face Typing: Vision-Based Perceptual Interface for Hands-Free Text Entry with a Scrollable Virtual Keyboard." IEEE/CVF Winter Conference on Applications of Computer Vision, 2012.](https://mlanthology.org/wacv/2012/gizatdinova2012wacv-face/) doi:10.1109/WACV.2012.6162997

BibTeX

@inproceedings{gizatdinova2012wacv-face,
  title     = {{Face Typing: Vision-Based Perceptual Interface for Hands-Free Text Entry with a Scrollable Virtual Keyboard}},
  author    = {Gizatdinova, Yulia and Spakov, Oleg and Surakka, Veikko},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2012},
  pages     = {81-87},
  doi       = {10.1109/WACV.2012.6162997},
  url       = {https://mlanthology.org/wacv/2012/gizatdinova2012wacv-face/}
}