ML Anthology

Robust Hand Gestural Interaction for Smartphone Based AR/VR Applications

Shreyash Mohatta, Ramakrishna Perla, Gaurav Gupta, Ehtesham Hassan, Ramya Hebbalaguppe
WACV 2017 pp. 330-335
doi:10.1109/WACV.2017.43 /wacv/2017/mohatta2017wacv-robust/

Abstract

The future of user interfaces will be dominated by hand gestures. In this paper, we explore an intuitive hand gesture based interaction for smartphones having a limited computational capability. To this end, we present an efficient algorithm for gesture recognition with First Person View (FPV), which focuses on recognizing a four swipe model (Left, Right, Up and Down) for smartphones through single monocular camera vision. This can be used with frugal AR/VR devices such as Google Cardboard <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> andWearality <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> in building AR/VR based automation systems for large scale deployments, by providing a touch-less interface and real-time performance. We take into account multiple cues including palm color, hand contour segmentation, and motion tracking, which effectively deals with FPV constraints put forward by a wearable. We also provide comparisons of swipe detection with the existing methods under the same limitations. We demonstrate that our method outperforms both in terms of gesture recognition accuracy and computational time.

WACV Semantic Scholar

Cite

Text

Mohatta et al. "Robust Hand Gestural Interaction for Smartphone Based AR/VR Applications." IEEE/CVF Winter Conference on Applications of Computer Vision, 2017. doi:10.1109/WACV.2017.43

Markdown

[Mohatta et al. "Robust Hand Gestural Interaction for Smartphone Based AR/VR Applications." IEEE/CVF Winter Conference on Applications of Computer Vision, 2017.](https://mlanthology.org/wacv/2017/mohatta2017wacv-robust/) doi:10.1109/WACV.2017.43

BibTeX

@inproceedings{mohatta2017wacv-robust,
  title     = {{Robust Hand Gestural Interaction for Smartphone Based AR/VR Applications}},
  author    = {Mohatta, Shreyash and Perla, Ramakrishna and Gupta, Gaurav and Hassan, Ehtesham and Hebbalaguppe, Ramya},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2017},
  pages     = {330-335},
  doi       = {10.1109/WACV.2017.43},
  url       = {https://mlanthology.org/wacv/2017/mohatta2017wacv-robust/}
}